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Preface 


This book presents a comprehensive treatment of the analysis and design of discrete- 
time control systems. It is written as a textbook for courses on discrete-time control 
systems or digital control systems for senior and first-year graduate level engineering 
students. 

In this second edition, some of the older material has been deleted and new 
material has been added throughout the book. The most significant feature of this 
edition is a greatly expanded treatment of the pole-placement design with minimum- 
order observer by means of the state-space approach (Chapter 6) and the polynomial- 
equations approach (Chapter 7). 

In this book all materials are presented in such a way that the reader can follow 
the discussions easily. All materials necessary for understanding the subject matter 
presented (such as proofs of theorems and steps for deriving important equations 
for pole placement and observer design) are included to ease understanding of the 
subject matter presented. 

The theoretical background materials for designing control systems are dis- 
cussed in detail. Once the theoretical aspects are understood, the reader can use 
MATLAB with advantage to obtain numerical solutions that involve various types 
of vector-matrix operations. It is assumed that the reader is familiar with the material 
presented in my book Solving Control Engineering Problems with MATLAB (Pren- 
tice Hall) or its equivalent. 

The prerequisites for the reader are a course on introductory control systems, 
a course on ordinary differential equations, and familiarity with MATLAB compu- 
tations. (If the reader is not familiar with MATLAB, it may be studied concurrently.) 


ix 


x Preface 


Since this book is written from the engineer's point of view, the basic concepts 
involved are emphasized and highly mathematical arguments are carefully avoided 
in the presentation. The entire text has been organized toward a gradual develop- 
ment of discrete-time control theory. 

The text is organized into eight chapters and three appendixes. The outline of 
the book is as follows: Chapter 1 gives an introduction to discrete-time control Sys- 
tems. Chapter 2 presents the z transform theory necessary for the study of discrete- 
time control systems. Chapter 3 discusses the z plane analysis of discrete-time 
systems, including impulse sampling, data hold, sampling theorem, pulse transfer 
function, and digital filters. Chapter 4 treats the design of discrete-time control 
systems by conventional methods. This chapter includes stability analysis of closed- 
loop systems in the z plane, transient and steady-state response analyses, and design 
based onthe root-locus method, frequency-response method, and analytical method. 

Chapter 5 presents state-space analysis, including state-space representations 
of discrete-time systems, pulse transfer function matrix, discretization method, and 
Liapunov stability analysis. Chapter 6 discusses pole-placement and observer design. 
This chapter contains discussions on controllability, observability, pole placement, 
state observers, and servo systems. Chapter 7 treats the polynomial equations 
approach to control systems design. This chapter first discusses the Diophantine 
equation and then presents the polynomial equations approach to control systems 
design. Finally, model matching control systems are designed using the polynomial 
equations approach. Chapter 8 presents quadratic optimal control. Both finite-stage 
and infinite-stage quadratic optimal control problems are discussed. This chapter 
concludes with a design problem based on quadratic optimal control solved with 
MATLAB. 

Appendix A presents a summary of vector-matrix analysis. Appendix B gives 
useful theorems of the z transform theory that were not presented in Chapter 2, the 
inversion integral method, and the modified z transform method. Appendix C 
discusses the pole-placement design problem when the control signal is a vector 
quantity. 

Examples are presented at strategic points throughout the book so that the 
reader will have a better understanding of the subject matter discussed. In addition, 
a number of solved problems (A problems) are provided at the end of each chapter, 
except Chapter 1. These problems represent an integral part of the text. It is sug- 
gested that the reader study all these problems carefully to obtain a deeper under- 
standing of the topics discussed. In addition, many unsolved problems (B problems) 
are provided for use as homework or quiz problems. 

Most of the materials presented in this book have been class-tested in 
senior and first-year graduate level courses on control systems at the University of 
Minnesota. 

All the materials in this book may be covered in two quarters. In a semester 
course, the instructor will have some flexibility in choosing the subjects to be 
covered. In a quarter course, a good part of the first six chapters may be covered. 
An instructor using this text can obtain a complete solutions manual from the 
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publisher. This book can also serve as a self-study book for practicing engineers who 
wish to study discrete-time control theory by themselves. 

Appreciation is due to my former students who solved all the solved problems 
(A problems) and unsolved problems (B problems) and made numerous construc- 
tive comments about the material in this book. 


Katsuhiko Ogata 
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Control Systems 


71-1 INTRODUCTION 


In recent years there has been a rapid increase in the use of digital controllers in 
control systems. Digital controls are used for achieving optimal performance—for 
example, in the form of maximum productivity, maximum profit, minimum cost, or 
minimum energy use. 

Most recently, the application of computer control has made possible "'intelli- 
gent" motion in industrial robots, the optimization of fuel economy in automobiles, 
and refinements in the operation of household appliances and machines such as 
microwave ovens and sewing machines, among others. Decision-making capability 
and flexibility in the control program are major advantages of digital control systems. 

The current trend toward digital rather than analog control of dynamic systems 
is mainly due to the availability of low-cost digital computers and the advantages 
found in working with digital signals rather than continuous-time signals. 


Types of Signals. A continuous-time signal is a signal defined over a contin- 
uous range of time. The amplitude may assume a continuous range of values or may 
assume only a finite number of distinct values. The process of representing a variable 
by a set of distinct values is called quantization, and the resulting distinct values are 
called quantized values. The quantized variable changes only by a set of distinct 
steps. 

An analog signal is a signal defined over a continuous range of time whose am- 
plitude can assume a continuous range of values. Figure 1-1(a) shows a continuous- 
time analog signal, and Figure 1-1(b) shows a continuous-time quantized signal 
(quantized in amplitude only). 
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Figure 1-1 (a) Continuous-time analog 
signal; (b) continuous-time quantized 
signal; (c) sampled-data signal; 

0 t (d) digital signal. 


Notice that the analog signal is a special case of the continuous-time signal. In 
practice, however, we frequently use the terminology “continuous-time” in lieu of 
"analog." Thus in the literature, including this book, the terms “continuous-time 
signal" and “analog signal" are frequently interchanged, although strictly speaking 
they are not quite synonymous. 

A discrete-time signal is a signal defined only at discrete instants of time (that 
is, one in which the independent variable t is quantized). In a discrete-time signal, 
if the amplitude can assume a continuous range of values, then the signal is called 
a sampled-data signal. A sampled-data signal can be generated by sampling an 
analog signal at discrete instants of time. It is an amplitude-modulated pulse signal. 
Figure 1-1(c) shows a sampled-data signal. 

A digital signal is a discrete-time signal with quantized amplitude. Such a signal 
can be represented by a sequence of numbers, for example, in the form of binary 
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numbers. (In practice, many digital signals are obtained by sampling analog signals 
and then quantizing them; it is the quantization that allows these analog signals to 
be read as finite binary words.) Figure 1-1(d) depicts a digital signal. Clearly, it is 
a signal quantized both in amplitude and in time. The use of the digital controller 
requires quantization of signals both in amplitude and in time. 

The term “discrete-time signal” is broader than the term "'digital signal" or the 
term “sampled-data signal." In fact, a discrete-time signal can refer either to a digital 
signal or to a sampled-data signal. In practical usage, the terms “discrete time" and 
“digital” are often interchanged. However, the term “discrete time” is frequently 
used in theoretical study, while the term “digital” is used in connection with hard- 
ware or software realizations. 

In control engineering, the controlled object is a plant or process. It may be 
a physical plant or process or a nonphysical process such as an economic process. 
Most plants and processes involve continuous-time signals, therefore, if digital 
controllers are involved in the control systems, signal conversions (analog to digital 
and digital to analog) become necessary. Standard techniques are available for such 
signal conversions; we shall discuss them in Section 1—4. 

Loosely speaking, terminologies such as discrete-time control systems, sam- 
pled-data control systems, and digital control systems imply the same type or very 
similar types of control systems. Precisely speaking, there are, of course, differences 
in these systems. For example, in a sampled-data control system both continuous- 
time and discrete-time signals exist in the system; the discrete-time signals are 
amplitude-modulated pulse signals. Digital control systems may include both contin- 
uous-time and discrete-time signals; here, the latter are in a numerically coded form. 
Both sampled-data control systems and digital control systems are discrete-time 
control systems. 

Many industrial control systems include continuous-time signals, sampled-data 
signals, and digital signals. Therefore, in this book we use the term ‘‘discrete-time 
control systems” to describe the control systems that include some forms of sampled- 
data signals (amplitude-modulated pulse signals) and/or digital signals (signals in 
numerically coded form). 


Systems Dealt With in This Book. The discrete-time control systems consid- 
ered in this book are mostly linear and time invariant, although nonlinear and/or 
time-varying systems are occasionally included in discussions. A linear system is one 
in which the principle of superposition applies. Thus, if y, is the response of the 
system to input x, and y; the response to input x2, then the system is linear if and 
only if, for every scalar a and £, the response to input ax, + Bx, is ay, + fy». 

A linear system may be described by linear differential or linear difference 
equations. A time-invariant linear system is one in which the coefficients in the 
differential equation or difference equation do not vary with time, that is, one in 
which the properties of the system do not change with time. 


Discrete-Time Control Systems and Continuous-Time Control Systems. 
Discrete-time control systems are control systems in which one or more variables can 
change only at discrete instants of time. These instants, which we shall denote by 
kTort,(k = 0,1,2,...), may specify the times at which some physical measurement 
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is performed or the times at which the memory of a digital computer is read out. The 
time interval between two discrete instants is taken to be sufficiently short that the 
data for the time between them can be approximated by simple interpolation. 

Discrete-time control systems differ from continuous-time control systems in 
that signals for a discrete-time control system are in sampled-data form or in digital 
form. If a digital computer is involved in a control system as a digital controller, any 
sampled data must be converted into digital data. 

Continuous-time systems, whose signals are continuous in time, may be de- 
scribed by differential equations. Discrete-time systems, which involve sampled- 
data signals or digital signals and possibly continuous-time signals as well, may be 
described by difference equations after the appropriate discretization of continuous- 
time signals. 


Sampling Processes. The sampling of a continuous-time signal replaces the 
original continuous-time signal by a sequence of values at discrete time points. A 
sampling process is used whenever a control system involves a digital controller, 
since a sampling operation and quantization are necessary to enter data into such 
a controller. Also, a sampling process occurs whenever measurements necessary for 
control are obtained in an intermittent fashion. For example, in a radar tracking 
system, as the radar antenna rotates, information about azimuth and elevation is 
obtained once for each revolution of the antenna. Thus, the scanning operation of 
the radar produces sampled data. In another example, a sampling process is needed 
whenever a large-scale controller or computer is time-shared by several plants in 
order to save cost. Then a control signal is sent out to each plant only periodically 
and thus the signal becomes a sampled-data signal. 

The sampling process is usually followed by a quantization process. In the 
quantization process the sampled analog amplitude is replaced by a digital ampli- 
tude (represented by a binary number). Then the digital signal is processed by the 
computer. The output of the computer is sampled and fed to a hold circuit. The 
output of the hold circuit is a continuous-time signal and is fed to the actuator. We 
shall present details of such signal-processing methods in the digital controller in 
Section 1-4. 

The term “discretization,” rather than "sampling," is frequently used in the 
analysis of multiple-input-multiple-output systems, although both mean basically 
the same thing. 

It is important to note that occasionally the sampling operation or discretiza- 
tion is entirely fictitious and has been introduced only to simplify the analysis of 
control systems that actually contain only continuous-time signals. In fact, we often 
use a suitable discrete-time model for a continuous-time system. An example is a 
digital-computer simulation of a continuous-time system. Such a digital-computer- 
simulated system can be analyzed to yield parameters that will optimize a given 
performance index. 

Most of the material presented in this book deals with control systems that can 
be modeled as linear time-invariant discrete-time systems. It is important to mention 
that many digital control systems are based on continuous-time design techniques. 
Since a wealth of experience has been accumulated in the design of continuous-time 
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controllers, a thorough knowledge of them is highly valuable in designing discrete- 
time control systems. 


1-2 DIGITAL CONTROL SYSTEMS 


Figure 1-2 depicts a block diagram of a digital control system showing a configura- 
tion of the basic control scheme. The system includes the feedback control and the 
feedforward control. In designing such a control system, it should be noted that the 
“goodness” of the control system depends on individual circumstances. We need to 
choose an appropriate performance index for a given case and design a controller 
so as to optimize the chosen performance index. 


Signal Forms in a Digital Control System. Figure 1-3 shows a block diagram 
of a digital control system. The basic elements of the system are shown by the blocks. 
The controller operation is controlled by the clock. In such a digital control system, 
some points of the system pass signals of varying amplitude in either continuous time 
or discrete time, while other points pass signals in numerical code, as depicted in the 
figure. 

The output of the plant is a continuous-time signal. The error signal is con- 
verted into digital form by the sample-and-hold circuit and the analog-to-digital 
converter. The conversion is done at the sampling time. The digital computer 
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Figure 1-2 Block diagram of a digital control system. 
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Figure 1-3 Block diagram of a digital control system showing signals in binary or graphic form. 


processes the sequences of numbers by means of an algorithm and produces new 
sequences of numbers. At every sampling instant a coded number (usually a binary 
number consisting of eight or more binary digits) must be converted to a physical 
control signal, which is usually a continuous-time or analog signal. The digital-to- 
analog converter and the hold circuit convert the sequence of numbers in numerical 
code into a piecewise continuous-time signal. The real-time clock in the computer 
synchronizes the events. The output of the hold circuit, a continuous-time signal, is 
fed to the plant, either directly or through the actuator, to control its dynamics. 

The operation that transforms continuous-time signals into discrete-time 
data is called sampling or discretization. The reverse operation, the operation that 
transforms discrete-time data into a continuous-time signal, is called data-hold; it 
amounts to a reconstruction of a continuous-time signal from the sequence of 
discrete-time data. It is usually done using one of the many extrapolation techniques. 
In many cases it is done by keeping the signal constant between the successive 
sampling instants. (We shall discuss such extrapolation techniques in Section 1-4.) 

The sample-and-hold (S/H) circuit and analog-to-digital (A/D) converter con- 
vert the continuous-time signal into a sequence of numerically coded binary words. 
Such an A/D conversion process is called coding or encoding. The combination of 
the S/H circuit and analog-to-digital converter may be visualized as a switch that 
closes instantaneously at every time interval T and generates a sequence of numbers 
in numerical code. The digital computer operates on such numbers in numerical code 
and generates a desired sequence of numbers in numerical code. The digital-to- 
analog (D/A) conversion process is called decoding. 


Definitions of Terms. Before we discuss digital control systems in detail, we 
need to define some of the terms that appear in the block diagram of Figure 1-3. 


Sample-and-Hold (S/H).  "Sample-and-hold" is a general term used for a 
sample-and-hold amplifier. It describes a circuit that receives an analog input signal 
and holds this signal at a constant value for a specified period of time. Usually the 
signal is electrical, but other forms are possible, such as optical and mechanical. 


es 
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Analog-to-Digital Converter (A/D). An analog-to-digital converter, also 
called an encoder, is a device that converts an analog signal into a digital signal, 
usually a numerically coded signal. Such a converter is needed as an interface 
between an analog component and a digital component. A sample-and-hold circuit 
is often an integral part of a commercially available A/D converter. The conversion 
of an analog signal into the corresponding digital signal (binary number) is an 
approximation, because the analog signal can take on an infinite number of values, 
whereas the variety of different numbers that can be formed by a finite set of digits 
is limited. This approximation process is called quantization. (More on quantization 
is presented in Section 1-3.) 


Digital-to-Analog Converter (D/A). A digital-to-analog converter, also 
called a decoder, is a device that converts a digital signal (numerically coded data) 
into an analog signal. Such a converter is needed as an interface between a digital 
component and an analog component. 


Plant or Process. A plant is any physical object to be controlled. Examples 
are a furnace, a chemical reactor, and a set of machine parts functioning together 
to perform a particular operation, such as a servo system or a spacecraft. 

A process is generally defined as a progressive operation or development 
marked by a series of gradual changes that succeed one another in a relatively 
fixed way and lead toward a particular result or end. In this book we call any 
operation to be controlled a process. Examples are chemical, economic, and biolog- 
ical processes. 

The most difficult part in the design of control systems may lie in the accurate 
modeling of a physical plant or process. There are many approaches to the plant or 
process model, but, even so, a difficulty may exist, mainly because of the absence 
of precise process dynamics and the presence of poorly defined random parameters 
in many physical plants or processes. Thus, in designing a digital controller, it is 
necessary to recognize the fact that the mathematical model of a plant or process 
in many cases is only an approximation of the physical one. Exceptions are found 
in the modeling of electromechanical systems and hydraulic-mechanical systems, 
since these may be modeled accurately. For example, the modeling of a robot arm 
system may be accomplished with great accuracy. 


Transducer. A transducer is a device that converts an input signal into an 
output signal of another form, such as a device that converts a pressure signal into 
a voltage output. The output signal, in general, depends on the past history of the 
input. 

Transducers may be classified as analog transducers, sampled-data transduc- 
ers, or digital transducers. An analog transducer is a transducer in which the input 
and output signals are continuous functions of time. The magnitudes of these signals 
may be any values within the physical limitations of the system. A sampled-data 
transducer is one in which the input and output signals occur only at discrete instants 
of time (usually periodic), but the magnitudes of the signals, as in the case of the 
analog transducer, are unquantized. A digital transducer is one in which the input 
and output signals occur only at discrete instants of time and the signal magnitudes 
are quantized (that is, they can assume only certain discrete levels). 
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Types of Sampling Operations. As stated earlier, a signal whose independent 
variable : is discrete is called a discrete-time signal. A sampling operation is basic 
in transforming a continuous-time signal into a discrete-time signal. 

There are several different types of sampling operations of practical impor- 
tance: 


1. Periodic sampling. In this case, the sampling instants are equally spaced, or 
t = KT (k = 0,1,2,...). Periodic sampling is the most conventional type of 
sampling operation. 

2. Multiple-order sampling. The pattern of the t,’s is repeated periodically; that 
is, t+, — t, is constant for all k. 

3. Multiple-rate sampling. In a control system having multiple loops, the largest 
time constant involved in one loop may be quite different from that in other 
loops. Hence, it may be advisable to sample slowly in a loop involving a large 
time constant, while in a loop involving only small time constants the sampling 
rate must be fast. Thus, a digital control system may have different sampling 
periods in different feedback paths or may have multiple sampling rates. 

4. Random sampling. In this case, the sampling instants are random, or & is a 
random variable. 


In this book we shall treat only the case where the sampling is periodic. 


1-3 QUANTIZING AND QUANTIZATION ERROR 


The main functions involved in analog-to-digital conversion are sampling, amplitude 
quantizing, and coding. When the value of any sample falls between two adjacent 
"permitted" output states, it must be read as the permitted output state nearest the 
actual value of the signal. The process of representing a continuous or analog signal 
by a finite number of discrete states is called amplitude quantization. That is, 
"quantizing" means transforming a continuous or analog signal into a set of discrete 
states. (Note that quantizing occurs whenever a physical quantity is represented 
numerically.) 

The output state of each quantized sample is then described by a numerical 
code. The process of representing a sample value by a numerical code (such as a 
binary code) is called encoding or coding. Thus, encoding is a process of assigning 
a digital word or code to each discrete state. The sampling period and quantizing 
levels affect the performance of digital control systems. So they must be determined 
carefully. 


Quantizing. The standard number system used for processing digital signals 
is the binary number system. In this system the code group consists of n pulses each 
indicating either “on” (1) or “off” (0). In the case of quantizing, n “on-off” pulses 
can represent 2" amplitude levels or output states. 

The quantization level Q is defined as the range between two adjacent decision 
points and is given by 
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where the FSR is the full-scale range. Note that the leftmost bit of the natural binary 
code has the most weight (one-half of the full scale) and is called the most significant 
bit (MSB). The rightmost bit has the least weight (1/2" times the full scale) and is 
called the least significant bit (LSB). Thus, 


isp - FSR 


The least significant bit is the quantization level Q. 


Quantization Error. Since the number of bits in the digital word is finite, A/D 
conversion results in a finite resolution. That is, the digital output can assume only 
a finite number of levels, and therefore an analog number must be rounded off to 
the nearest digital level. Hence, any A/D conversion involves quantization error. 
Such quantization error varies between 0 and +}Q. This error depends on the 
fineness of the quantization level and can be made as small as desired by making the 
quantization level smaller (that is, by increasing the number of bits n). In practice, 
there is a maximum for the number of bits n, and so there is always some error due 
to quantization. The uncertainty present in the quantization process is called quan- 
tization noise. 

To determine the desired size of the quantization level (or the number of output 
states) in a given digital control system, the engineer must have a good understanding 
of the relationship between the size of the quantization level and the resulting error. 
The variance of the quantization noise is an important measure of quantization error, 
since the variance is proportional to the average power associated with the noise. 

Figure 1-4(a) shows a block diagram of a quantizer together with its input- 
output characteristics. For an analog input x(t), the output y(t) takes on only a finite 
number of levels, which are integral multiples of the quantization level Q. 

In numerical analysis the error resulting from neglecting the remaining digits 
is called the round-off error. Since the quantizing process is an approximating 
process in that the analog quantity is approximated by a finite digital number, the 
quantization error is a round-off error. Clearly, the finer the quantization level is, 
the smaller the round-off error. 

Figure 1-4(b) shows an analog input x(t) and the discrete output y(t), which 
is in the form of a staircase function. The quantization error e(t) is the difference 
between the input signal and the quantized output, or 


e(t) = x(t) — y(t) 
Note that the magnitude of the quantized error is 
0 = le 339 


For a small quantization level Q, the nature of the quantization error is similar 
to that of random noise. And, in effect, the quantization process acts as a source of 
random noise. In what follows we shall obtain the variance of the quantization noise. 
Such variance can be obtained in terms of the quantization level Q. 
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Figure 1-4 (a) Block diagram of a quantizer and its input-output characteristics; 
(b) analog input x(t) and discrete output y(t); (c) probability distribution P(e) of 
quantization error e(t). 


Suppose that the quantization level Q is small and we assume that the quan- 
tization error e(t) is distributed uniformly between —1 Q and 1 Q and that this error 
acts as a white noise. [This is obviously a rather rough assumption. However, since 
the quantization error signal e(t) is of a small amplitude, such an assumption may 
be acceptable as a first-order approximation.] The probability distribution P(e) of 
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signal e(t) may be plotted as shown in Figure 1—4(c). The average value of e(t) is zero, 
or e(t) = 0. Then the variance o? of the quantization noise is 


2 fn» 1 [9? 2 Q? 

o = E]|e(t) — e(t =3f dé == 

LO-0F=5] eui 

Thus, if the quantization level Q is small compared with the average amplitude of 


the input signal, then the variance of the quantization noise is seen to be one-twelfth 
of the square of the quantization level. 


1-4 DATA ACQUISITION, CONVERSION, AND 
DISTRIBUTION SYSTEMS 


With the rapid growth in the use of digital computers to perform digital control 
actions, both the data-acquisition system and the distribution system have become 
an important part of the entire control system. 


'The signal conversion that takes place in the digital control system involves the 
following operations: 


1. Multiplexing and demultiplexing 

2. Sample and hold 

3. Analog-to-digital conversion (quantizing and encoding) 
4. Digital-to-analog conversion (decoding) 


Figure 1—5(a) shows a block diagram of a data-acquisition system, and Figure 1-5(b) 
shows a block diagram of a data-distribution system. 

In the data-acquisition system the input to the system is a physical variable such 
as position, velocity, acceleration, temperature, or pressure. Such a physical variable 
is first converted into an electrical signal (a voltage or current signal) by a suitable 


Physical Low-pass Analog Sample-and- A/D To digita! 
variable Lv | nod converter controller 


{a} 


From digital D/A 
controller Register Demultiplexer converter To actuator 


(b) 


Figure 1-5 (a) Block diagram of a data-acquisition system; (b) block diagram of a data- 
distribution system. 


Input channels 
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transducer. Once the physical variable is converted into a voltage or current signal, 
the rest of the data-acquisition process is done by electronic means. 

In Figure 1—5(a) the amplifier (frequently an operational amplifier) that fol- 
lows the transducer performs one or more of the following functions: It amplifies 
the voltage output of the transducer; it converts a current signal into a voltage signal; 
or it buffers the signal. The low-pass filter that follows the amplifier attenuates the 
high-frequency signal components, such as noise signals. (Note that electronic noises 
are random in nature and may be reduced by low-pass filters. However, such 
common electrical noises as power-line interference are generally periodic and may 
be reduced by means of notch filters.) The output of the low-pass filter is an analog 
signal. This signal is fed to the analog multiplexer. The output of the multiplexer is 
fed to the sample-and-hold circuit, whose output is, in turn, fed to the analog-to- 
digital converter. The output of the converter is the signal in digital form; it is fed 
to the digital controller. 

The reverse of the data-acquisition process is the data-distribution process. As 
shown in Figure 1—5(b), a data-distribution system consists of registers, a demulti- 
plexer, digital-to-analog converters, and hold circuits. It converts the signal in digital 
form (binary numbers) into analog form. The output of the D/A converter is fed to 
the hold circuit. The output of the hold circuit is fed to the analog actuator, which, 
in turn, directly controls the plant under consideration. 

In the following, we shall discuss each individual component involved in the 
signal-processing system. 


Analog Multiplexer. An analog-to-digital converter is the most expensive 
component in a data-acquisition system. The analog multiplexer is a device that 
performs the function of time-sharing an A/D converter among many analog chan- 
nels. The processing of a number of channels with a digital controller is possible 
because the width of each pulse representing the input signal is very narrow, so the 
empty space during each sampling period may be used for other signals. If many 
signals are to be processed by a single digital controller, then these input signals must 
be fed to the controller through a multiplexer. 

Figure 1-6 shows a schematic diagram of an analog multiplexer. The analog 


To sampler 


Figure 1-6 Schematic diagram of an 
analog multiplexer. 
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multiplexer is a multiple switch (usually an electronic switch) that sequentially 
switches among many analog input channels in some prescribed fashion. The number 
of channels, in many instances, is 4, 8, or 16. At a given instant of time, only one 
switch is in the “on” position. When the switch is on in a given input channel, the 
input signal is connected to the output of the multiplexer for a specified period of 
time. During the connection time the sample-and-hold circuit samples the signal 
voltage (analog signal) and holds its value, while the analog-to-digital converter 
converts the analog value into digital data (binary numbers). Each channel is read 
in a sequential order, and the corresponding values are converted into digital data 
in the same sequence. 


Demultiplexer. The demultiplexer, which is synchronized with the input sam- 
pling signal, separates the composite output digital data from the digital controller 
into the original channels. Each channel is connected to a D/A converter to produce 
the output analog signal for that channel. 


Sample-and-Hold Circuits. A sampler in a digital system converts an analog 
signal into a train of amplitude-modulated pulses. The hold circuit holds the value 
of the sampled pulse signal over a specified period of time. The sample-and-hold is 
necessary in the A/D converter to produce a number that accurately represents the 
input signal at the sampling instant. Commercially, sample-and-hold circuits are 
available in a single unit, known as a sample-and-hold (S/H). Mathematically, 
however, the sampling operation and the holding operation are modeled separately 
(see Section 3-2). It is common practice to use a single analog-to-digital converter 
and multiplex many sampled analog inputs into it. 

In practice, sampling duration is very short compared with the sampling period 
T. When the sampling duration is negligible, the sampler may be considered an 
“ideal sampler." An ideal sampler enables us to obtain a relatively simple mathemat- 
ical model for a sample-and-hold. (Such a mathematical model will be discussed in 
detail in Section 3-2). 

Figure 1-7 shows a simplified diagram for the sample-and-hold. The S/H circuit 
is an analog circuit (simply a voltage memory device) in which an input voltage is 
acquired and then stored on a high-quality capacitor with low leakage and low 
dielectric absorption characteristics. 

In Figure 1-7 the electronic switch is connected to the hold capacitor. Opera- 
tional amplifier 1 is an input buffer amplifier with a high input impedance. Op- 
erational amplifier 2 is the output amplifier; it buffers the voltage on the hold 
capacitor. 

There are two modes of operation for a sample-and-hold circuit: the tracking 
mode and the hold mode. When the switch is closed (that is, when the input signal 
is connected), the operating mode is the tracking mode. The charge on the capacitor 
in the circuit tracks the input voltage. When the switch is open (the input signal is 
disconnected), the operating mode is the hold mode and the capacitor voltage holds 
constant for a specified time period. Figure 1-8 shows the tracking mode and the 
hold mode. 

Note that, practically speaking, switching from the tracking mode to the hold 
mode is not instantaneous. If the hold command is given while the circuit is in the 


Input and output signals 
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Figure 1-7 Sample-and-hold circuit. 


tracking mode, then the circuit will stay in the tracking mode for a short while before 
reacting to the hold command. The time interval during which the switching takes 
place (that is, the time interval when the measured amplitude is uncertain) is called 
the aperture time. 

The output voltage during the hold mode may decrease slightly. The hold mode 
droop may be reduced by using a high-input-impedance output buffer amplifier. 
Such an output buffer amplifier must have very low bias current. 

The sample-and-hold operation is controlled by a periodic clock. 


Types of Analog-to-Digital (A/D) Converters. As stated earlier, the process by 
which a sampled analog signal is quantized and converted to a binary number is 
called analog-to-digital conversion. Thus, an A/D converter transforms an analog 


Input Sample to Hold mode 
hold offset 


Aperture 
time 


Output 
signal 


Tracking Hold t 
mode mode Zo - 


Hold command Figure 1-8 "Tracking mode and hold 
is given here mode. 


Sec. 1-4 Data Acquisition, Conversion, and Distribution Systems 15 


signal (usually in the form of a voltage or current) into a digital signal or numerically 
coded word. In practice, the logic is based on binary digits composed of Os and 1s, 
and the representation has only a finite number of digits. The A/D converter 
performs the operations of sample-and-hold, quantizing, and encoding. Note that 
in the digital system a pulse is supplied every sampling period T by a clock. The A/D 
converter sends a digital signal (binary number) to the digital controller each time 
a pulse arrives. 

Among the many A/D circuits available, the following types are used most 
frequently: 


1. Successive-approximation type 
2. Integrating type 

3. Counter type 

4. Parallel type 


Each of these four types has its own advantages and disadvantages. In any particular 
application, the conversion speed, accuracy, size, and cost are the main factors to 
be considered in choosing the type of A/D converter. (If greater accuracy is needed, 
for example, the number of bits in the output signal must be increased.) 

As will be seen, analog-to-digital converters use as part of their feedback loops 
digital-to-analog converters. The simplest type of A/D converter is the counter type. 
The basic principle on which it works is that clock pulses are applied to the digital 
counter in such a way that the output voltage of the D/A converter (that is, part of 
the feedback loop in the A/D converter) is stepped up one least significant bit (LSB) 
at a time, and the output voltage is compared with the analog input voltage once for 
each pulse. When the output voltage has reached the magnitude of the input voltage, 
the clock pulses are stopped. The counter output voltage is then the digital output. 

The successive-approximation type of A/D converter is much faster than the 
counter type and is the one most frequently used. Figure 1-9 shows a schematic 
diagram of the successive-approximation type of A/D converter. 
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Figure 1-9 Schematic diagram of a successive-approximation-type of A/D converter. 
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The principle of operation of this type of A/D converter is as follows. The 
successive-approximation register (SAR) first turns on the most significant bit (half 
the maximum) and compares it with the analog input. The comparator decides 
whether to leave the bit on or turn it off. If the analog input voltage is larger, the 
most significant bit is set on. The next step is to turn on bit 2 and then compare the 
analog input voltage with three-fourths of the maximum. After n comparisons are 
completed, the digital output of the successive-approximation register indicates all 
those bits that remain on and produces the desired digital code. Thus, this type of 
A/D converter sets 1 bit each clock cycle, and so it requires only n clock cycles to 
generate n bits, where n is the resolution of the converter in bits. (The number n 
of bits employed determines the accuracy of conversion.) The time required for the 
conversion is approximately 2 usec or less for a 12-bit conversion. 


Errors in AID Converters. Actual analog-to-digital signal converters differ 
from the ideal signal converter in that the former always have some errors, such as 
Offset error, linearity error, and gain error, the characteristics of which are shown 
in Figure 1-10. Also, it is important to note that the input-output characteristics 
change with time and temperature. 

Finally, it is noted that commercial converters are specified for three basic 
temperature ranges: commercial (0°C to 70°C), industrial (—25?C to 85°C), and 
military (—55?C to 125°C). 


Digital-to-Analog (D/A) Converters. At the output of the digital controller the 
digital signal must be converted to an analog signal by the process called digital-to- 
analog conversion. A D/A converter is a device that transforms a digital input (binary 
numbers) to an analog output. The output, in most cases, is the voltage signal. 

For the full range of the digital input, there are 2” corresponding different 
analog values, including 0. For the digital-to-analog conversion there is a one-to-one 
correspondence between the digital input and the analog output. 

Two methods are commonly used for digital-to-analog conversion: the method 
using weighted resistors, and the one using the R-2R ladder network. The former 
is simple in circuit configuration, but its accuracy may not be very good. The latter 
is a little more complicated in configuration, but is more accurate. 

Figure 1-11 shows a schematic diagram of a D/A converter using weighted 
resistors. The input resistors of the operational amplifier have their resistance values 
weighted in a binary fashion. When the logic circuit receives binary 1, the switch 
(actually an electronic gate) connects the resistor to the reference voltage. When the 
logic circuit receives binary 0, the switch connects the resistor to ground. The 
digital-to-analog converters used in common practice are of the parallel type: all bits 
act simultaneously upon application of a digital input (binary numbers). 

The D/A converter thus generates the analog output voltage corresponding 
to the given digital voltage. For the D/A converter shown in Figure 1-11, if the 
binary number is b; b; b; bo, where each of the b’s can be either a 0 or a 1, then the 
output is 


he 


Sec. 1-4 Data Acquisition, Conversion, and Distribution Systems 17 


(a) 100 


111 


(b) 100 


Gain error 


(c) 100 


Figure 1-10 Errors in A/D converters: 
(a) offset error; (b) linearity error; 
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Notice that as the number of bits is increased the range of resistor values becomes 
large and consequently the accuracy becomes poor. 

Figure 1-12 shows a schematic diagram of an n-bit D/A converter using an 
R-2R ladder circuit. Note that with the exception of the feedback resistor (which 
is 3R) all resistors involved are either R or 2R. This means that a high level of 
accuracy can be achieved. The output voltage in this case can be given by 


1 
2 

Reconstructing the Input Signal by Hold Circuits. The sampling operation pro- 
duces an amplitude-modulated pulse signal. The function of the hold operation is 
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Figure 1-11 Schematic diagram of a D/A converter using weighted resistors. 


to reconstruct the analog signal that has been transmitted as a train of pulse samples. 
That is, the purpose of the hold operation is to fill in the spaces between sampling 
periods and thus roughly reconstruct the original analog input signal. 

The hold circuit is designed to extrapolate the output signal between successive 
points according to some prescribed manner. The staircase waveform of the output 
shown in Figure 1-13 is the simplest way to reconstruct the original input signal. The 
hold circuit that produces such a staircase waveform is called a zero-order hold. 
Because of its simplicity, the zero-order hold is commonly used in digital control 
systems. 


Figure 1-12 n-Bit D/A converter using an R-2R ladder circuit. 
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Figure 1-13 Output from a zero-order 
0 t hold. 


More sophisticated hold circuits are available than the zero-order hold. These 
are called higher-order hold circuits and include the first-order hold and the second- 
order hold. Higher-order hold circuits will generally reconstruct a signal more 
accurately than a zero-order hold, but with some disadvantages, as explained next. 

The first-order hold retains the value of the previous sample, as well as the 
present one, and predicts, by extrapolation, the next sample value. This is done by 
generating an output slope equal to the slope of a line segment connecting previous 
and present samples and projecting it from the value of the present sample, as shown 
in Figure 1-14. 

As can easily be seen from the figure, if the slope of the original signal does 
not change much, the prediction is good. If, however, the original signal reverses its 
slope, then the prediction is wrong and the output goes in the wrong direction, thus 
causing a large error for the sampling period considered. 

An interpolative first-order hold, also called a polygonal hold, reconstructs the 
original signal much more accurately. This hold circuit also generates a straight-line 
output whose slope is equal to that joining the previous sample value and the present 
sample value, but this time the projection is made from the current sample point with 


Output 


Output 


Figure 1-14 Output from a first-order 
0 t hold. 
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Figure 1-15 Output from an inter- 
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the amplitude of the previous sample. Hence, the accuracy in reconstructing the 
original signal is better than for other hold circuits, but there is a one-sampling- 
period delay, as shown in Figure 1-15. In effect, the better accuracy is achieved at 
the expense of a delay of one sampling period. From the viewpoint of the stability 
of closed-loop systems, such a delay is not desirable, and so the interpolative 
first-order hold (polygonal hold) is not used in control system applications. 


1-5 CONCLUDING COMMENTS 


In concluding this chapter we shall compare digital controllers and analog controllers 
used in industrial control systems and review digital control of processes. Then we 
shall present an outline of the book. 


Digital Controllers and Analog Controllers. Digital controllers operate only 
on numbers. Decision making is one of their important functions. They are often 
used to solve problems involved in the optimal overall operation of industrial plants. 

Digital controllers are extremely versatile. They can handle nonlinear control 
equations involving complicated computations or logic operations. A very much 
wider class of control laws can be used in digital controllers than in analog con- 
trollers. Also, in the digital controller, by merely issuing a new program the oper- 
ations being performed can be changed completely. This feature is particularly 
important if the control system is to receive operating information or instructions 
from some computing center where economic analysis and optimization studies are 
made. T 

Digital controllers are capable of performing complex computations with 
constant accuracy at high speed and can have almost any desired degree of compu- 
tational accuracy at relatively little increase in cost. 

Originally, digital controllers were used as components only in large-scale 
control systems. At present, however, thanks to the availability of inexpensive 
microcomputers, digital controllers are being used in many large- and small-scale 
control systems. In fact, digital controllers are replacing the analog controllers that 
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have been used in many small-scale control systems. Digital controllers are often 
superior in performance and lower in price than their analog counterparts. 

Analog controllers represent the variables in an equation by continuous phys- 
ical quantities. They can easily be designed to serve satisfactorily as non-decision- 
making controllers. But the cost of analog computers or analog controllers increases 
rapidly as the complexity of the computations increases, if constant accuracy is to 
be maintained. 

There are additional advantages of digital controllers over analog controllers. 
Digital components, such as sample-and-hold circuits, A/D and D/A converters, and 
digital transducers, are rugged in construction, highly reliable, and often compact 
and lightweight. Moreover, digital components have high sensitivity, are often 
cheaper than their analog counterparts, and are less sensitive to noise signals. And, 
as mentioned earlier, digital controllers are flexible in allowing programming 
changes. 


Digital Control of Processes. In industrial process control systems, it is gen- 
erally not practical to operate for a very long time at steady state, because certain 
changes may occur in production requirements, raw materials, economic factors, 
and processing equipments and techniques. Thus, the transient behavior of indus- 
trial processes must always be taken into consideration. Since there are interactions 
among process variables, using only one process variable for each control agent is 
not suitable for really complete control. By the use of a digital controller, it is 
possible to take into account all process variables, together with economic factors, 
production requirements, equipment performance, and all other needs, and thereby 
to accomplish optimal control of industrial processes. 

Note that a system capable of controlling a process as completely as possible 
will have to solve complex equations. The more complete the control, the more 
important it is that the correct relations between operating variables be known and 
used. The system must be capable of accepting instructions from such varied sources 
as computers and human operators and must also be capable of changing its control 
subsystem completely in a short time. Digital controllers are most suitable in such 
situations. In fact, an advantage of the digital controller is flexibility, that is, ease 
of changing control schemes by reprogramming. 

In the digital control of a complex process, the designer must have a good 
knowledge of the process to be controlled and must be able to obtain its mathemat- 
ical model. (The mathematical model may be obtained in terms of differential 
equations or difference equations, or in some other form.) The designer must be 
familiar with the measurement technology associated with the output of the process 
and other variables involved in the process. He or she must have a good working 
knowledge of digital computers as well as modern control theory. If the process is 
complicated, the designer must investigate several different approaches to the design 
of the control system. In this respect, a good knowledge of simulation techniques 
is helpful. 


Outline of the Book. The objective of this book is to present a detailed 
account of the control theory that is relevant to the analysis and design of discrete- 
time control systems. Our emphasis is on understanding the basic concepts involved. 
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In this book, digital controllers are often designed in the form of pulse transfer 
functions or equivalent difference equations, which can be easily implemented in the 
form of computer programs. 

The outline of the book is as follows. Chapter 1 has presented introductory ma- 
terial. Chapter 2 presents the z transform theory. This chapter includes z transforms 
of elementary functions, important properties and theorems of the z transform, the 
inverse z transform, and the solution of difference equations by the z transform 
method. Chapter 3 treats background materials for the z plane analysis of control 
systems. This chapter includes discussions of impulse sampling and reconstruction 
of original signals from sampled signals, pulse transfer functions, and realization of 
digital controllers and digital filters. 

Chapter 4 first presents mapping between the s plane and the z plane and then 
discusses stability analysis of closed-loop systems in the z plane, followed by tran- 
sient and steady-state response analyses, design by the root-locus and frequency- 
response methods, and an analytical design method. Chapter 5 gives state- 
space representation of discrete-time systems, the solution of discrete-time state- 
space equations, and the pulse transfer function matrix. Then, discretization of 
continuous-time state-space equations and Liapunov stability analysis are treated. 

Chapter 6 presents control systems design in the state space. We begin the 
chapter with a detailed presentation of controllability and observability. We then 
present design techniques based on pole placement, followed by discussion of 
full-order state observers and minimum-order state observers. We conclude this 
chapter with the design of servo systems. Chapter 7 treats the polynomial-equations 
approach to the design of control systems. We begin the chapter with discussions of 
Diophantine equations. Then we present the design of regulator systems and control 
systems using the solution of Diophantine equations. The approach here is an 
alternative to the pole-placement approach combined with minimum-order observ- 
ers. The design of model-matching control systems is included in this chapter. 
Finally, Chapter 8 treats quadratic optimal control problems in detail. 

The state-space analysis and design of discrete-time control systems, presented 
in Chapters 5, 6, and 8, make extensive use of vectors and matrices. In studying these 
chapters the reader may, as need arises, refer to Appendix A, which summarizes the 
basic materials of vector-matrix analysis. Appendix B presents materials in z trans- 
form theory not included in Chapter 2. Appendix C treats pole-placement design 
problems when the control is a vector quantity. 

In each chapter, except Chapter 1, the main text is followed by solved problems 
and unsolved problems. The reader should study all solved problems carefully. 
Solved problems are an integral part of the text. Appendixes A, B, and C are 
followed by solved problems. The reader who studies these solved problems will have 
an increased understanding of the material presented. 
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The z Transform 


2-1 INTRODUCTION 


A mathematical tool commonly used for the analysis and synthesis of discrete-time 
control systems is the z transform. The role of the z transform in discrete-time 
systems is similar to that of the Laplace transform in continuous-time systems. 

In a linear discrete-time control system, a linear difference equation character- 
izes the dynamics of the system. To determine the system's response to a given input, 
such a difference equation must be solved. With the z transform method, the solu- 
tions to linear difference equations become algebraic in nature. (Just as the Laplace 
transformation transforms linear time-invariant differential equations into algebraic 
equations in 5, the z transformation transforms linear time-invariant difference 
equations into algebraic equations in z.) 

The main objective of this chapter is to present definitions of the z transform, 
basic theorems associated with the z transform, and methods for finding the inverse 
z transform. Solving difference equations by the z transform method is also dis- 
cussed. 


Discrete-Time Signals. Discrete-time signals arise if the system involves a 
sampling operation of continuous-time signals. The sampled signal is x(0), x(T), 
x(2T),..., where T is the sampling period. Such a sequence of values arising from 
the sampling operation is usually written as x(kT). If the system involves an iterative 
process carried out by a digital computer, the signal involved is a number sequence 
x(0), x (1), x(2). ... The sequence of numbers is usually written as x(k), where the 
argument k indicates the order in which the number occurs in the sequence, for 
example, x(0), x (1), x(2). ... Although x(k) is a number sequence, it can be con- 
sidered as a sampled signal of x(t) when the sampling period T is 1 sec. 
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The z transform applies to the continuous-time signal x(t), sampled signal 
x(kT), and the number sequence x(k). In dealing with the z transform, if no 
confusion occurs in the discussion, we occasionally use x(kT) and x(k) interchange- 
ably. [That is, to simplify the presentation, we occasionally drop the explicit appear- 
ance of T and write x(kT) as x(k).] 


Outline of the Chapter. Section 2-1 has presented introductory remarks. 
Section 2-2 presents the definition of the z transform and associated subjects. 
Section 2-3 gives z transforms of elementary functions. Important properties and 
theorems of the z transform are presented in Section 2-4. Both analytical and 
computational methods for finding the inverse z transform are discussed in Section 
2—5. Section 2-6 presents the solution of difference equations by the z transform 
method. Finally, Section 2-7 gives concluding comments. 


2-2 THE z TRANSFORM 


The z transform method is an operational method that is very powerful when 
working with discrete-time systems. In what follows we shall define the z transform 
of a time function or a number sequence. 
In considering the z transform of a time function x(t), we consider only the 
sampled values of x (t), that is, x (0), x(T), x(2T), . .. , where Tis the sampling period. 
The z transform of a time function x(t), where t is nonnegative, or of a sequence 
of values x(kT), where k takes zero or positive integers and T is the sampling period, 
is defined by the following equation: 
X(z) = Z[x(t)] = Z|x(kT)] = XS x(kT)z * (2-1) 
k=0 
For a sequence of numbers x(k), the z transform is defined by 
X(z) = Zl) = È xz (2-2) 
k=0 
The z transform defined by Equation (2-1) or (2-2) is referred to as the one-sided 
z transform. 
The symbol Z denotes “the z transform of." In the one-sided z transform, 
we assume x(t) = Ofort < Oorx(k) = Ofork < 0. Note that z isa complex variable. 
Note that, when dealing with a time sequence x(kT) obtained by sampling a 
time signal x(t), the z transform X(z) involves T explicitly. However, for a number 
sequence x(k), the z transform X(z) does not involve T explicitly. 
The z transform of x(t), where —o < t < c, or of x(k), where k takes integer 
values (k = 0, +1, +2,---), is defined by 
X(z) = Z[x()] = Z[x(kT) = DX x(kT)z* (2-3) 
k2-o 


or 


eo 


XQ) = zb] = È xk) (2-4) 
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The z transform defined by Equation (2-3) or (2—4) is referred to as the two-sided 
z transform. In the two-sided z transform, the time function x(t) is assumed to be 
nonzero for f < 0 and the sequence x(k) is considered to have nonzero values for 
k < 0. Both the one-sided and two-sided z transforms are series in powers of z7!. 
(The latter involves both positive and negative powers of z !.) In this book, only the 
one-sided z transform is considered in detail. 

For most engineering applications the one-sided z transform will have a con- 
venient closed-form solution in its region of convergence. Note that whenever X(z), 
an infinite series in z~', converges outside the circle |z| = R, where R is called the 
radius of absolute convergence, in using the z transform method for solving discrete- 
time problems it is not necessary each time to specify the values of z over which X(z) 
is convergent. 

Notice that expansion of the right-hand side of Equation (2-1) gives 


X(z) = x(0) + x(T)z + xQT)z ? + + + x(kTz* t (2-5) 


Equation (2-5) implies that the z transform of any continuous-time function x(t) may 
be written in the series form by inspection. The z “ in this series indicates the position 
in time at which the amplitude x(kT) occurs. Conversely, if X(z) is given in the series 
form as above, the inverse z transform can be obtained by inspection as a sequence 
of the function x(KT) that corresponds to the values of x(t) at the respective instants 
of time. 

If the z transform is given as a ratio of two polynomials in z, then the inverse 
z transform may be obtained by several different methods, such as the direct division 
method, the computational method, the partial-fraction-expansion method, and the 
inversion integral method (see Section 2-5 for details.) 


2-3 z TRANSFORMS OF ELEMENTARY FUNCTIONS 


In the following we shall present z transforms of several elementary functions. It is 
noted that in one-sided z transform theory, in sampling a discontinuous function x(t), 
we assume that the function is continuous from the right; that is, if discontinuity 
occurs at f = 0, then we assume that x(0) is equal to x(0+) rather than to the average 
at the discontinuity, [x(0—) + x(0+)]/2. 


Unit-Step Function. Let us find the z transform of the unit-step function 


. J1(t), 0st 
*() = B t«0 


As just noted, in sampling a unit-step function we assume that this function is 
continuous from the right; that is, 1(0) = 1. Then, referring to Equation (2-1), we 
have 


X(z) = Z[1(0] = X 1z% = x z* 


=Ltzt+z7+z 4 6e 
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2-1 


Notice that the series converges if |z| > 1. In finding the z transform, the variable 
z acts as a dummy operator. It is not necessary to specify the region of z over which 
X(z) is convergent. It suffices to know that such a region exists. The z transform 
X(z) of a time function x(t) obtained in this way is valid throughout the z plane 
except at poles of X(z). 

It is noted that 1(k) as defined by 


1, k=0,1,2,... 
09 = {5 k «0 


is commonly called a unit-step sequence. 
Unit-Ramp Function. Consider the unit-ramp function 


t, 0st 
x(t) = n t«0 
Notice that 


x(kT)=kT, k-0,12,... 


Figure 2-1 depicts the sampled unit-ramp signal. The magnitudes of the sampled 
values are proportional to the sampling period T. The z transform of the unit-ramp 
function can be written as 
X(z) = Z[] = È x(kT)z* = X kTz* = TD kz 
k=0 k=0 k=0 
= T(z! + 22°? + 3z3 +---) 


-1 
z 
kerz 


_ Tz 
| G-1 


x(t) 


Figure 2-1 Sampled unit-ramp signal. 
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Note that it is a function of the sampling period T. 
Polynomial Function a‘. Let us obtain the z transform of x(k) as defined by 


_ fa, k20,1,2,... 
«9 = 1o k «0 
where a is a constant. Referring to the definition of the z transform given by 
Equation (2-2), we obtain 


X(z) = Z[a^] = È x(k)z* = Xa 


k-0 


—-ltaz'!taGàz?tdGz?54.e 


_ 1 
1- az! 
| z 
z—a 


Exponential Function. Let us find the z transform of 


-at - 
=d” Zo 
Since 
x(kT) = e, k =0,1,2,... 
we have 


æ 


X(z) = Z [e] = È x(kT)z* = 5 e T z 


k=0 


=1]+ ez EN e "777 + e T2? +. 


_ 1 
1-e%z} 

_ z 

= z- e T 


Sinusoidal Function. Consider the sinusoidal function 


sin wt, Ost 
«0 - [5 t«0 


Noting that 
e = cos ot + j sin wt 
e/ = cos ot — j sin wt 


we have 


1, , 
i = — jot — o Jet 
sin wt 2j (e ef) 
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Since the z transform of the exponential function is 


-a 1 
dd mr 
we have 
X(z) = Z [sin wt] = zl (e/*' = e) 
iie de 
2j 1 € eT 771 1 _ e i" 271 
2j 1 — (eT + ta ie + z^? 
= _ z'sneT —— 
1 — 2z7! coswT + z? 
-Zino 
z? — 2z coswT + 1 
Example 2-1 


Obtain the z transform of the cosine function 
_ J cos ot, 0zt 
x() = i t«0 
If we proceed in a manner similar to the way we treated the z transform of the 
sine function, we have 
X(z) = Z [cos wt] = 1 Z [e" + e] 
1 1 1 
TAa Py ee Lp eT, 
2\1 -— ez pez 
.1 2 _ (e 7*7 4 e7z? 
21 - (e + e271 + 27 
_ 1 — z` coswT 
1 — 2z7' coswT tz? 
_ z - z coswT 
z? — 2z coswT + 1 


Example 2-2 
Obtain the z transform of 


1 
BENS s(s + 1) 


Whenever a function in s is given, one approach for finding the corresponding z 
transform is to convert X(s) into x(t) and then find the z transform of x(t). Another 
approach is to expand X(s) into partial fractions and use a z transform table to find the 
z transforms of the expanded terms. Still other approaches will be discussed in 
Section 3-3. 
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The inverse Laplace transform of X(s) is 


x(t) -1-e*, 0zt 


Hence, 


X(z2-22[1-e'- 1 ae = 1 
2 (1-e7)z! 
(1-z9)ü-e7z)) 
2 0-7 ex 
(z -9G-e7) 
Comments. Just as in working with the Laplace transformation, a table of z 


transforms of commonly encountered functions is very useful for solving problems 
in the field of discrete-time systems. Table 2-1 is such a table. 


TABLE 2-1 TABLE OF z TRANSFORMS 
x(t) 


x(kT) or x(k) 


Kronecker delta &(k) 
1, k= 


Rae 


1 
FE i 
1 1 
1 Tz! 
s $ a py 


Tu (1 + 4z7' +277) 
qd - zy 


a Ad e Tz?! 
(-zb(ü-e*z) 


a 
l 
Ei 
E 
| 
^ 
l 
a 
* 
* 


- 
| 
^ 


^o 
^ 
m 


€ 
A 
ta 
+ 
a 
— 


(eT Ee etz 
G tas tb) ° Soe (1-ez7)0 ez") 


kea 
l 
a 
k 
EI 
| 
^ 
I 
EJ 
1 
& 
= 
3 
l 
v 
x 
3 


Te "z^! 
(1 ES ez) 


Ly 
a 
x: 
a 
1 
x 
5 


a 
+ 
a 
& 
d 


= 
> 
= 


1-(0-*aT)e "z^ 
a A e zy 
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Te (1 + ez z^ 
él = e zy 


TABLE 2-1 (continued) 


X(s) 


x(t) X(KT) or x(k) 


| 


2,-at 


te (kTY eT 


(s + ay 
a 
2 Se +a) at- 1 +e” akT — 1 + eT 
w 


= 


[(aT — 1 + e *7) + (1 = e" —aTe ")z pz" 
(1-z yY(1-e*z! 


z sineT 
1-2z cosoT + z? 


m" 


= - A 
un 
DA 
tle 
& 
t2 


A 
oo 


sin wkT 


1-27! coswT 
1 — 2z7' coswT + 27 


COS wt cos okT 


g. 
5 
& 


e "*zsinoT 


1-2e'z' coswT + e° z? 


an 
9 


e sin wt e "*" sin wkT 


sta d oe 
—a ma] e™ cos at e "** cos okT 
(s * ay +o 


1—e7zcosoT 


1-2e "zcoseT + e z^? 


= 


= 
$ 


-1 
z 
ka TEE 


(1 — az )yY 


* 
i 


z (1- az) 
(1— az y 


= 
N 
* 

! 


a 


z (1-*4az ^! + dz?) 
(1 - az ^y 


N 
N 


kat! 


z™'(1 + 1laz™ + 11a?z? + a° z>) 
23. Aight 
al o [ q æ | (1 - az y 
1 
k ——— 
Mo [j [reel mm O O 
25. k(k — 1) zee 
2! - zz 
m k(k — 1): (k -m + 2) zm 
i (m — 1)! (1-27) 
27. K(k = 1) ac: ae 
2! (à — az y 
k(k - 1) (k -m*2) Ls mel 
(m — 1)! s: (1— az)” 


x(t) = 0, for t <0. 
x(kT) = x(k) = 0, for k <0. 
Unless otherwise noted, k = 0,1,2,3,.... 


Sec. 2-4 Important Properties and Theorems of the z Transform 31 


2-4 IMPORTANT PROPERTIES AND THEOREMS 
OF THE z TRANSFORM 


The use of the z transform method in the analysis of discrete-time control systems 
may be facilitated if theorems of the z transform are referred to. In this section we 
present important properties and useful theorems of the z transform. We assume that 
the time function x(t) is z-transformable and that x(f) is zero for t < 0. 


Multiplication by a Constant. If X(z) is the z transform of x(t), then 
Z [ax(t)] = a Z[x(0] = aX(z) 
where a is a constant. 
To prove this, note that by definition 


Z [ax(t)] = X ax(kT)z" =a > x(kT)z * = aX(z) 


Linearity of the z Transform. The z transform possesses an important prop- 
erty: linearity. This means that, if f(k) and g(k) are z-transformable and o and 8 
are scalars, then x(k) formed by a linear combination 


x(k) = af(k) + Bg(k) 
has the z transform 
X(z) = aF(z) + BG(z) 


where F(z) and G(z) are the z transforms of f(k) and g(k), respectively. 
The linearity property can be proved by referring to Equation (2-2) as follows: 


X(z) = Z[x(k)] = Z [af(k) + Bg(k)] 


2 [af() + Bg())z * 


li 


aX fü + 8X «(z^ 


aZ [f + BZ[g(k)] 
aF(z) + BG(z) 


Multiplication by a*. If X(z) is the z transform of x(k), then the z transform 
of a‘ x(k) can be given by X(a™'z): 


Z [a x(k)] = X(a^!z) (2-6) 


This can be proved as follows: 


æ% 


Z [a^ x(k)] = X at x(k)z = X x(k)(az)* 


k=0 
= X(a!z) 
Shifting Theorem. The shifting theorem presented here is also referred to as 


the real translation theorem. If x(t) = 0 fort < 0 and x(t) has the z transform X(z), 
then 
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Z[x(t - nT)]  z ^X(z) (2-7) 


and 
Z [x(t + nT)] = zx) — Srne] (2-8) 


where n is zero or a positive integer. 
To prove Equation (2-7), note that 
Z [x(t - nT)] = D x(kT — nT)z* 
k=0 


=z" » x(kT — nT)z ^? (2-9) 
By defining m = k — n, Equation (2-9) can be written as follows: 
Z[x(t - nT)) 2 z " » x(mT)z" 
Since x(mT) — 0 for m « 0, we may change the lower limit of the summation from 
m = —n to m = 0. Hence, 


oo 


Z[x(t - nT)] = 27 > x(mT)z™ = z^ X(z) (2-10) 


Thus, multiplication of a z transform by z™ has the effect of delaying the time 
function x(t) by time nT. (That is, move the function to the right by time nT.) 
To prove Equation (2-8), we note that 


Z[x(t + nT)] = DX x(kT + nT)z* 


k=0 


x(kT  nT)z **? 


PEG + nT)z 69 + 5 x(kT)z7* - xen 


IRE TMs TE 


1 
Eg pm 


X(KTyz"* — Sane 


= fol — S rare] 
For the number sequence x(k), Equation (2-8) can be written as follows: 
Z [x(k *n)- zx) = S r(e] 
From this last equation, we obtain 


Z [x(k + 1)] = zX(z) — zx(0) (2-11) 
Z|x(k + 2] = zZ [x(k + 1)] — zx(1) = z X(z) — 2?x(0) — zx(1) (2-12) 
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Similarly, 
Z [x(k + n)] 

= z"X(z) — z"x(0) — z"!x(1) — z"?xQ) — +++ — zx(n - 1) (2-13) 
where n is a positive integer. 

Remember that multiplication of the z transform X(z) by z has the effect of 
advancing the signal x(kT) by one step (1 sampling period) and that multiplication 
of the z transform X(z) by z ! has the effect of delaying the signal x(kT) by one step 
(1 sampling period). 

Example 2-3 
Find the z transforms of unit-step functions that are delayed by 1 sampling period 


and 4 sampling periods, respectively, as shown in Figure 2-2(a) and (b). 
Using the shifting theorem given by Equation (2-7), we have 


ZuE- D)- z^ £O) = se 
Also, 
zu -47]-z"*z[(0]- z *1 7A =I a 


(Note that z^ ' represents a delay of 1 sampling period T, regardless of the value of T.) 


Example 2-4 
Obtain the z transform of 
| ja* k = 1,2,3, 
f(a) = B k<0 
x(t) 
1(t - T) 
1 
0 T 2T | aT AT ST 6T 77 8T t 
(a) 
x(t) 
Wt - 47) 
1 
0 T 2T 3T 4T 57 67 7T 8r t 


Figure 2-2 (a) Unit-step function 
delayed by 1 sampling period; (b) unit- 
step function delayed by 4 sampling 

(bl periods. 
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Referring to Equation (2-7), we have 
Z [x(k - 1) = z ! X(z) 


The z transform of a* is 
Z [a^] = dE 
and so 


c = Ffal] = -1 m 

£[fa)] - Za] = 2 1I—— = 
where k = 1,2,3,.... 

Example 2-5 


Consider the function y(k), which is a sum of functions x(A), where h = 0,1,2,...,k 
such that 


, 


k 


y(k) = Nx) k-20,,2,.. 


h-0 


where y(k) = 0 for k « 0. Obtain the z transform of y(k). 
First note that 


y(k) = x(0) + x(1) + -++ + x(k — 1) + x(k) 
y(k — 1) = x(0) + x(1) * --- + x(k — 1) 


Hence, 
y(k) — y(k — 1) = x(k), k=0,1,2,... 
Therefore, 
Z[y(k) - y(k - 1)] = Z [x(k)] 
or 


Y(z) - z '! Y(z) = X(z) 
which yields 
1 
YG) -i—zg4X6) 

where X(z) = Z [x(k)]. 

Complex Translation Theorem. If x(t) has the z transform X(z), then the z 
transform of e " x(t) can be given by X(ze*’). This is known as the complex trans- 
lation theorem. 

To prove this theorem, note that 


eo œ 


Z[e"x()) = Dx(kT)e Tz = E x(kT)(ze)™* = X(ze) ^ (2-14) 


k=0 k=0 
Thus, we see that replacing z in X(z) by ze“ gives the z transform of e^" x(t). 
Example 2-6 


Given the z transforms of sin wt and cos wt, obtain the z transforms of e^" sin wt and 
€ * cos wt, respectively, by using the complex translation theorem. 
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Noting that 
"X 
z sinoT 
Zz sin Ol | = a 
[ ] 1-2z'coseT + z”? 
we substitute ze" for z to obtain the z transform of e~” sin wt, as follows: 
-aT ,-—1 a: 
artis e" z sinwT 
Z [e sin wt] = ———z—r-———————zr—35 
[ ] 1 — 2e7*7 z7! coswT + e? Tz? 


Similarly, for the cosine function, we have 


1-—z ) coswT 


Z [cos wf] = 1-2z !cosoT + z ? 


By substituting ze^" for z in the z transform of cos wt, we obtain 
M 1— ez coswT 

Z [e " cos wt] = — =F r Tr 

l l 1 -— 2e7*7 z7' coswT + e "Tz? 


Example 2-7 


Obtain the z transform of te ^. 
Notice that 
27! 


Z(t} = a- dou XO) 
Thus, 


Te ^Tz^! 


Z [te ^] = X(ze*") = U- ez 7 


Initial Value Theorem. If x(t) has the z transform X (z) and if lim X(z) exists, 
then the initial value x(0) of x(t) or x(k) is given by 


x(0) = lim X(z) (2-15) 


To prove this theorem, note that 


EJ 


X(z) = » x(k)z^* = x(0) + x(1)z7! + x(2)z ? + 


Letting z — o in this last equation, we obtain Equation (2-15). The behavior of the 
signal in the neighborhood of t = 0 ork = 0 can thus be determined by the behavior 
of X(z) at z = œ, 

The initial value theorem is convenient for checking z transform calculations 
for possible errors. Since x(0) is usually known, a check of the initial value by 
lim X(z) can easily spot errors in X(z), if any exist. 


Example 2-8 
Determine the initial value x(0) if the z transform of x(t) is given by 
(1 — e77)z7! 
(1-2 500-e7z) 
By using the initial value theorem, we find 


(1-7 e! 
x(0) = STIS z ')1-ez) 


X(z) - 


-0 
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Referring to Example 2-2, notice that this X(z) was the z transform of 
x(t) -1-e* 


and thus x(0) = 0, which agrees with the result obtained earlier. 


Final Value Theorem. Suppose that x(k), where x(k) = 0 for k < 0, has the 
z transform X(z) and that all the poles of X(z) lie inside the unit circle, with the 
possible exception of a simple pole at z = 1. [This is the condition for the stability 
of X(z), or the condition for x(k) (k = 0,1,2,...) to remain finite.] Then the final 
value of x(k), that is, the value of x(k) as k approaches infinity, can be given by 


lim x(k) = lim [(1 — z )X()] (2-16) 


To prove the final value theorem, note that 


oo 


Z[x(k)] = X(z) = 2 x(k)z 


œ% 


Z [x(k - 1)] = z! X(z) = È x(k - 1)z7* 


k=0 


Hence, 


oo o 


D x(k)z* — S x(k — 1)z™% = X(z) - z!X(z) 


k=0 k=0 
Taking the limit as z approaches unity, we have 
im] X x(k)z* — X x(k - pz] = lin[(1 — z X(z)] 
z>1 Lk=0 k=0 zl 


Because of the assumed stability condition and the condition that x(k) = 0 for 
k « 0, the left-hand side of this last equation becomes 


2 (k) — x(k - 9] = [x(0) - x(-1)] + XQ) - x(0)] 
+ EQ) 7 xQ)] + +++ = x(9) = lim x(k) 


Hence, 
lim x(k) = lim [1 - z")X(z)] 
kon z= 


which is Equation (2-16). The final value theorem is very useful in determining the 
behavior of x(k) as k — œ from its z transform X(z). 


Example 2-9 
Determine the final value x(~) of 


1 1 


Xe) = Sa c ee get ge 


by using the final value theorem. 
By applying the final value theorem to the given X(z), we obtain 
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x(#) = lim[(1 - 2-)X@)] 


ye (Cee C NEL. 
= im | " — 1-e 77"! 


It is noted that the given X(z) is actually the z transform of 
x(t) =1-e” 
By substituting t = © in this equation, we have 
x(9) = lim (1 - e*) = 1 
As a matter of course, the two results agree. 


Summary. In this section we have presented important properties and theo- 
rems of the z transform that will prove to be useful in solving many z transform 
problems. For the purpose of convenient reference, these important properties and 
theorems are summarized in Table 2-2. (Many of the theorems presented in this 
table are discussed in this section. Those not discussed here but included in the table 
are derived or proved in Appendix B.) 


2-5 THE INVERSE z TRANSFORM 


The z transformation serves the same role for discrete-time control systems that the 
Laplace transformation serves for continuous-time control systems. For the z trans- 
form to be useful, we must be familiar with methods for finding the inverse z 
transform. 

The notation for the inverse z transform is Z~'. The inverse z transform of 
X(z) yields the corresponding time sequence x(k). 

It should be noted that only the time sequence at the sampling instants is 
obtained from the inverse z transform. Thus, the inverse z transform of X(z) yields 
a unique x(k), but does not yield a unique x(t). This means that the inverse z 
transform yields a time sequence that specifies the values of x(t) only at discrete 
instants of time, £ = 0,7,27,..., and says nothing about the values of x(t) at all 
other times. That is, many different time functions x(t) can have the same x(KT). 
See Figure 2-3. 

When X(z), the z transform of x(kT) or x(k), is given, the operation that 
determines the corresponding x(kT) or x(k) is called the inverse z transformation. 
An obvious method for finding the inverse z transform is to refer to a z transform 
table. However, unless we refer to an extensive z transform table, we may not be 
able to find the inverse z transform of a complicated function of z. (If we use a less 
extensive table of z transforms, it is necessary to express a complex z transform as 
a sum of simpler z transforms. Refer to the partial-fraction-expansion method 
presented in this section.) 

Other than referring to z transform tables, four methods for obtaining the 
inverse z transform are commonly available: 
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TABLE 2-2 IMPORTANT PROPERTIES AND THEOREMS OF THE z TRANSFORM 


E 

wl) +b 
HAN o sA 
E 
TEE 


x(t * kT) z* X(z) — z*x(0) — z*^ x(T) - -+> — zx(kT - T) 
x(t — kT) z * X(z) 

x(n +k) z* X(z) — z*x(0) — z^ x(1) - --- — zx(k — 1) 
x(n — k) z * X(z) 


is) 
= 
i 


d 

dz 

z 
“) 

a* x(k) 

ka* x(k) ~4x(2) 

x(0) lim X(z) if the limit exists 


lim[(1 — z )X(z)] if (1 — z7')X(z) is analytic on 
z>1 and outside the unit circle 


i 


m 


~ 
~ 
~~ 


um 


=. — m. 


x(~) 


18. | Vx(k) = x(k) — x(k — 1) (1 — z')X(z) 
[romene 


— 
o 


0 


N 


S a 


23 


24 
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es 
0 T 2T 3T 4T t 


Figure 2-3 Two different continuous-time functions, x,(f) and x(t), that have the 
same values att = 0, T, 2T,.... 


1. Direct division method 

2. Computational method 

3. Partial-fraction-expansion method 
4. Inversion integral method 


In obtaining the inverse z transform, we assume, as usual, that the time 
sequence x(kT) or x(k) is zero for k < 0. 

Before we present the four methods, however, a few comments on poles and 
zeros of the pulse transfer function are in order. 


Poles and Zeros in the z Plane. In engineering applications of the z transform 
method, X(z) may have the form 


boz” + bz" e b, 


aps z+ az! tita, 


(m = n) (2-17) 


or 


by(z — ziz — z2)::: (Z — Zm) 

(z -p) —p3cs (2 = p») 
where the p;’s (i = 1,2,...,m) are the poles of X(z) and the z,’s (j = 1,2,..., m) 
the zeros of X(z). 

The locations of the poles and zeros of X(z) determine the characteristics of 
x(k), the sequence of values or numbers. As in the case of the s plane analysis of 
linear continuous-time control systems, we often use a graphical display in the z 
plane of the locations of the poles and zeros of X(z). 

Note that in control engineering and signal processing X(z) is frequently 
expressed as a ratio of polynomials in z~', as follows: 


byz 070 + bz miy desees bz" 
l*az!ltaz?^cte-ctaz" 


X(z) = 


X(z) = (2-18) 
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where z ^! is interpreted as the unit delay operator. In this chapter, where the basic 
properties and theorems of the z transform method are presented, X(z) may be 
expressed in terms of powers of z, as given by Equation (2-17), or in terms of powers 
of z^', as given by Equation (2-18), depending on the circumstances. 

In finding the poles and zeros of X (2), it is convenient to express X (z) as a ratio 
of polynomials in z. For example, 


— 2+0.5z — z(z+0.5) 
Xe) = araz G+ DeD 
Clearly, X(z) has poles at z = —1 and z = —2 and zeros at z = 0 and z = —0.5. 


If X(z) is written as a ratio of polynomials in z !, however, the preceding X(z) can 
be written as 


X() = 1+05z7 — 1+ 0.527 
1-32!47227? (142°) +227) 
Although poles atz = —1 and z = —2 and a zero at z = —0.5 are clearly seen from 


the expression, a zero at z = 0 is not explicitly shown, and so the beginner may fail 
to see the existence of a zero at z = 0. Therefore, in dealing with the poles and zeros 
of X (z), it is preferable to express X(z) as a ratio of polynomials in z, rather than 
polynomials in z~'. In addition, in obtaining the inverse z transform by use of the 
inversion integral method, it is desirable to express X(z) as a ratio of polynomials 
in z, rather than polynomials in z~', to avoid any possible errors in determining the 
number of poles at the origin of function X(z)z* !. 


Direct Division Method. In the direct division method we obtain the inverse 
z transform by expanding X(z) into an infinite power series in z^!. This method is 
useful when it is difficult to obtain the closed-form expression for the inverse z 
transform or it is desired to find only the first several terms of x(k). 

The direct division method stems from the fact that if X(z) is expanded into 
a power series in z^! , that is, if 


X(z) = Xx(kT)z^* 


k-0 


= x(0) + x(D)z^! + xQT)z? + ++ + x(kT)z* + +>: 


or 


X(z) = © x(k)z™ 


= x(0)  x(1)z^! + x(2)z ? + + x()z t $e 


then x(kT) or x(k) is the coefficient of the z^* term. Hence, the values of x(kT) or 
x(k) for k = 0,1,2,... can be determined by inspection. 

If X(z) is given in the form of a rational function, the expansion into an infinite 
power series in increasing powers of z^! can be accomplished by simply dividing the 
numerator by the denominator, where both the numerator and denominator of X(z) 
are written in increasing powers of z^. If the resulting series is convergent, the 
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coefficients of the z * term in the series are the values x(kT) of the time sequence 
or the values of x(k) of the number sequence. 

Although the present method gives the values of x(0), x(T), x(2T), .. . or the 
values of x(0), x(1), x(2), ... in a sequential manner, it is usually difficult to obtain 
an expression for the general term from a set of values of x(KT) or x(k). 


Example 2-10 
Find x(k) for k = 0,1,2,3,4 when X(z) is given by 


10z +5 
X(z) = — À——— 
(207c-1)76G-92 
First, rewrite X(z) as a ratio of polynomials in z~', as follows: 
10z ^ + 5z? 
X(z) = z 5z 


1-122! + 0.2277 
Dividing the numerator by the denominator, we have 


10z^! + 17z ? + 18.4z ? + 18.6824 + --- 
1-12z!-02z?J0z'-05z^? 
102^! - 122 2? + 22? 


1727? -2z7 ? 
1772 ? — 20.4z ? + 3.4z * 
18.4z ? - 3.4z * 


18.4z ° — 22.082 ^ + 3.682 ^ 
18.68z * — 3.68? 
18.68z * — 22.4162 ^ + 3.736z 5 
Thus, 
X(z) = 102^! + 17z ? + 18.42 ? + 18.687 * + --- 


By comparing this infinite series expansion of X(z) with X(z) = Di-ox(k)z“, 


we obtain 
x(0) =0 
x(1) = 10 
x(2) = 17 
x(3) = 18.4 
x(4) = 18.68 


As seen from this example, the direct division method may be carried out by hand 
calculations if only the first several terms of the sequence are desired. In general, the 
method does not yield a closed-form expression for x(k), except in special cases. 


Example 2-11 
Find x(k) when X(z) is given by 


By dividing the numerator by the denominator, we obtain 
—1 


z - - - - 
XG)-rL;-£:5-£rj4£zj-£rt4 6e 
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By comparing this infinite series expansion of X(z) with X(z) = 9-ox(k)z *, we 


obtain 
x(0) =0 
x(1) =1 
x(2) = -1 
x(3) = 1 


x(4) = -1 


This is an alternating signal of 1 and —1, which starts from k = 1. Figure 2-4 shows 
a plot of this signal. 


Example 2-12 
Obtain the inverse z transform of 
X(z) = 1 +227! + 3z? + Az? 


The transform X(z) is already in the form of a power series in z !. Since X(z) 
has a finite number of terms, it corresponds to a signal of finite length. By inspection, 


we find 
x(0) 21 
x(1) 22 
x(2) = 3 
x(3) =4 


All other x(k) values are zero. 


Computational Method. — In what follows, we present two computational ap- 
proaches to obtain the inverse z transform. 


1. MATLAB approach 
2. Difference equation approach 


Consider a system G(z) defined by 


GG = 0.467327! — 0.33932? 
z) = 12 1.5327z~ + 0.660727 


In finding the inverse z transform, we utilize the Kronecker delta function &(kT), 
where 


(2-19) 


k Figure 2-4 Alternating signal of 1 and 


—1 starting from k = 1. 
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&(kT) = 1, fork =0 
= 0, fork #0 


Assume that x(k), the input to the system G(z), is the Kronecker delta 
input, or 


x(k) = 1, fork = 0 
= 0, fork #0 
The z transform of the Kronecker delta input is 
X(z)=1 
Using the Kronecker delta input, Equation (2-19) can be rewritten as 


Y(z) _ 0.4673z ' — 0.33932 * 
X(z) 1-1.5327z ' + 0.66072 ? 
0.4673z — 0.3393 
| 2? — 1,5327z + 0.6607 t 
MATLAB Approach. MATLAB can be used for finding the inverse z 
transform. Referring to Equation (2-20), the input X(z) is the z transform of the 
Kronecker delta input. In MATLAB the Kronecker delta input is given by 


G(z) = 


x = [1 zeros(1,N)] 


where N corresponds to the end of the discrete-time duration of the process consid- 
ered. 

Since the z transform of the Kronecker delta input X(z) is equal to unity, the 
response of the system to this input is 


Yie) = Gie) = D Du = 0.339327 _ _ _ 0.46732 — 0.3393 
T= 1.532721 + 0.66072? z? — 1.53272 + 0.6607 


Hence the inverse z transform of G(z) is given by y(0), y(1), y(2),.... Let us obtain 
y(k) up to k = 40. 

To obtain the inverse z transform of G(z) with MATLAB, we proceed as 
follows: Enter the numerator and denominator as follows: 


num = [0 0.4673  —0.3393] 
den = [1 -—1.5327 0.6607] 


Enter the Kronecker delta input. 

x-—[1 zeros(1,40)] 
Then enter the command 

y = filter(num,den,x) 


to obtain the response y(k) from k = 0 to k = 40. 
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Summarizing, the MATLAB program to obtain the inverse z transform or the 
response to the Kronecker delta input is as shown in MATLAB Program 2-1. 


MATLAB Program 2-1 


Yo ---------- Finding inverse z transform ---------- 
% ***** Finding the inverse z transform of G(z) is the same as 
% finding the response of the system Y(z)/X(z) = G(z) to the 
% Kronecker delta input ***** 


P ***** Enter the numerator and denominator of G(z) ***** 


num = [0 0.4673 -0.3393]; 
den = [1 -1:5327 0.6607]; 


% ***** Enter the Kronecker delta input x and filter command 
% y = filter(num,den,x) ***** 


x= [1. zeros(1,40)]; 
y = filter(num,den,x) 


4 


If this program is executed, the screen will show the output y(k) from k = 0 to 40 
as follows: 


Columns 1 through 7 
O 0.4673 0.3769 0.2690 0.1632 0.0725 0.0032 
Columns 8 through 14 
—0.0429 —0.0679 —0.0758 —0.0712 —0.0591 —0.0436 —0.0277 
Columns 15 through 21 
—0.0137 —0.0027 0.0050 0.0094 0.0111 0.0108 0.0092 
Columns 22 through 28 
0.0070 0.0046 0.0025 0.0007 —0.0005 —0.0013 -0.0016 
Columns 29 through 35 
—0.0016 —0.0014 —0.0011 —0.0008 —0.0004 -0.0002 0.0000 
Columns 36 through 41 
0.0002 0.0002 0.0002 0.0002 0.0002 0.0001 


(Note that MATLAB computations begin from column 1 and end at column 41, 
rather than from column 0 to column 40.) These values give the inverse z transform 
of G(z). That is, 


y(0) =0 
y(1) = 0.4673 
y(2) = 0.3769 


y(3) = 0.2690 
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y (40) = 0.0001 


To plot the values of the inverse z transform of G(z), follow the procedure 
given in the following. 


Plotting Response to the Kronecker Delta Input. Consider the system given by 


Equation (2-20). A possible MATLAB program to obtain the response of this 
system to the Kronecker delta input is shown in MATLAB Program 2-2. The 


corresponding plot is shown in Figure 2-5. 


|. MATLAB Program 2-2 


96 ---------- Response to Kronecker delta input -——— 
num = [0 0.4673 -0.33935 —— 

| dene[i. -1,5327 0.6607]; 

xz[t zeros(1,40)]; 

ve(0 40 -1 1); 

axis(y); 

k= 0:40; 

y = filter(num,den,x); 

plottk,y,'o!) 

grid - ee ee 
titlel'Response to Kronecker Delta Input") 
xlabel(’k’) 
ylabel('y(k)') 


Response to Kronecker Delta Input 


'T -r T— -r —r v -—T —T 


0000000000000000000000004 


ylk) 
o 
e n 
— ——T 
o 


o 
o9 
o0go029 


-0.2 4 


“0 5 10 15 20 25 30 35 40 


Figure 2-5 Response of the system defined by Equation (2-20) to the Kronecker 
delta input. 
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If we wish to connect consecutive points (open circles, o) by straight lines, we 
need to modify the plot command from plot(k,y,o) to plot(k,y,'o" k,y,'—"). 


Difference Equation Approach. Noting that Equation (2-20) can be written as 
(z? — 1.5327z + 0.6607)Y(z) = (0.4673z — 0.3393)X(z) 
we can convert this equation into the difference equation as follows: 
y(k + 2) — 1.5327y(k + 1) + 0.6607y(k) 
= 0.4673x(k + 1) — 0.3393x(k) (2-21) 


where x(0) = 1 and x(k) = 0 for k #0, and y(k) = 0 for k <0. [x(k) is the 
Kronecker delta input.] 


The initial data y(0) and y(1) can be determined as follows: By substituting 
k — —2 into Equation (2-21), we find 


y(0) — 1.5327y(-1) + 0.6607, (—2) = 0.4673x(—1) — 0.3393x(—2) 


from which we get 
y(0) =0 
Next, by substituting k = —1 into Equation (2-21), we obtain 
y (1) — 1.5327y(0) + 0.6607y(—1) = 0.4673x(0) — 0.3393x(—1) 
from which we get 
y(1) = 0.4673 


Finding the inverse z transform of Y(z) now becomes a matter of solving the 
following difference equation for y(k): 


y(k + 2) — 1.5327y(k + 1) + 0.6607y(k) 
= 0.4673x(k + 1) — 0.3393x(k) — (2-22) 


with the initial data y(0) = 0, y(1) = 0.4673, x(0) = 1, and x(k) = 0 for k #0. 
Equation (2-22) can be solved easily by hand, or by use of BASIC, FORTRAN, or 
other. 


Partial-Fraction-Expansion Method. The partial-fraction expansion method 
presented here, which is parallel to the partial-fraction-expansion method used in 
Laplace transformation, is widely used in routine problems involving z transforms. 
The method requires that all terms in the partial fraction expansion be easily 
recognizable in the table of z transform pairs. 

To find the inverse z transform, if X(z) has one or more zeros at the origin 
(z = 0), then X(z)/z or X(z) is expanded into a sum of simple first- or second-order 
terms by partial fraction expansion, and a z transform table is used to find the 
corresponding time function of each expanded term. It is noted that the only reason 
that we expand X(z)/z into partial fractions is that each expanded term has a form 
that may easily be found from commonly available z transform tables. 
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Example 2-13 
Before we discuss the partial-fraction-expansion method, we shall review the shifting 
theorem. Consider the following X(z): 


zi 


X(z) = 1 = az! 


By writing zX (z) as Y(z), we obtain 


2X(z) = Ye) =a 


Referring to Table 2-1, the inverse z transform of Y(z) can be obtained as follows: 
z '[Y(z)] = yk) = a 
Hence, the inverse z transform of X(z) = z ! Y(z) is given by 
zZ '[X(z)] = x(k) = y(k - 1) 
Since y(k) is assumed to be zero for all k < 0, we have 


|jyk-10-2a^!', k= 1,2,3,... 
«e = {2 k <0 


Consider X(z) as given by 


boz” + byz" 3 t+ ee + Dm Z + Om 


X(z) = 
V) z” + dz" s Wb ügaz d, 


, men 
To expand X(z) into partial fractions, we first factor the denominator polynomial 
of X(z) and find the poles of X(z): 


boz” + bz +-+- + bm- t bm 
X07 Gpe- p) = p) 
We then expand X(z)/z into partial fractions so that each term is easily recognizable 
in a table of z transforms. If the shifting theorem is utilized in taking inverse z 
transforms, however, X(z), instead of X(z)/z, may be expanded into partial frac- 
tions. The inverse z transform of X(z) is obtained as the sum of the inverse z 
transforms of the partial fractions. 

A commonly used procedure for the case where all the poles are of simple order 
and there is at least one zero at the origin (that is, bm = 0) is to divide both sides 
of X(z) by z and then expand X(z)/z into partial fractions. Once X (z )/z is expanded, 
it will be of the form 


X(@) mcd ln eei oe an 
z z=p 27 Pr Z — Pn 
The coefficient a; can be determined by multiplying both sides of this last equation 
byz — p;andsettingz = p;. This will result in zero for all the terms on the right-hand 
side except the a; term, in which the multiplicative factor z — p; has been canceled 
by the denominator. Hence, we have 


a = [e = X 
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Note that such determination of a; is valid only for simple poles. 
If X(z)/z involves a multiple pole, for example, a double pole at z = p, and 
no other poles, then X(z)/z will have the form 
X(z) 2 cı €; 
z (z-p) z-n 


The coefficients c; and c; are determined from 


e - pace E p22] 


It is noted that if X(z)/z involves a triple pole at z = p;, then the partial fractions 
must include a term (z + p,)/(z — pi. (See Problem A-2-8.) 
Example 2-14 
Given the z transform 
a-e) 
(z - 0G - e7) 
where a is a constant and T is the sampling period, determine the inverse z transform 
x(kT) by use of the partial-fraction-expansion method. 
The partial fraction expansion of X(z)/z is found to be : 
BAD) os then, do kh 
z z—-1 z-e 


X(z) = 


Thus, 


From Table 2-1 we find 


Hence, the inverse z transform of X(z) is 
x(kT) -1— e ***, k =0,1,2,... 

Example 2-15 

Let us obtain the inverse z transform of 

z? +z+2 

(z- 1)(z2°- z + 1) 
by use of the partial-fraction-expansion method. 

We may expand X(z) into partial fractions as follows: 
4 -3z +2 427! —3z71 + 227 


j= ———— = cpu 
z-1 2-zt+1 1-z! 1-z'!'-z? : 


X(z) = 


X(z) = 


-+ 
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Noting that the two poles involved in the quadratic term of this last equation are 
complex conjugates, we rewrite X(z) as follows: 


4z^! z™ — 0.577? 0.527? 
xo) = -E ])-z'-4z? 
1 1- 0.527! 0.5z ! 
= 145-1 -1 
S 1-z! 2 l-z pr * fogs 
Since 
1-e*T'z^coseT 


Z [e "*" cos okT] = ———— ———Ér—3 
l | 1—-2e""z coswT + e "z^? 


px 
ez sinwT 
c —akT n: ra E Vc naL PENNE, 
Z [e ^" sin ekT] = — Sra a -2aT.-3 
1-2e""z 'cosoT +e Z 


by identifying e-?*7 — 1 and coswT =} in this case, we have wT = 7/3 and 


sin oT = V3/2. Hence, we obtain 


Em -1 
ahas 0.57 | = 1* TNR 


1-z!-4-z? 3 
and 
ar E 
Thus, we have 
x(k) = 4(1*7) - 3(1*7) cos 07 + a0 sn D7 
Rewriting, we have 
D MON CE Kee 1, 2535 ba 
0, k<0 
The first several values of x(k) are given by 
x(0) =0 
x(1) =1 
x(2) = 3 
x(3) =6 
x(4) 2 7 


x(5) =5 


Note that the inverse z transform of X(z) can also be obtained as follows: 


1 z` z^ 
X = =A = es MN E n e 
Gre ae in -zi«4 =) Pes ea Taa? 


Since 
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and 
-1 
onl z ER k _ Km 
Z [al Va Q) sin; 
we have 
MAE. uum LL 
wf 2V3 sin + ^ sin uu Soc 
0, k=0 


Although this solution may look different from the one obtained earlier, both solutions 
are correct and yield the same values for x(k). 


Inversion Integral Method. This is a useful technique for obtaining the in- 
verse z transform. The inversion integral for the z transform X(z) is given by 


Z"[X(z)] = x(kT) = x(k) = iat. X(z)2" dz (2-23) 


where C is a circle with its center at the origin of the z plane such that all poles of 

X(z)z*"! are inside it. [For the derivation of Equation (2-23), see Appendix B.] 
The equation for giving the inverse z transform in terms of residues can be 

derived by using theory of complex variables. It can be obtained as follows: 


x(kT) = x(k) = Ky + K + +++ + Kp 


= > [residue of X(z)z*~! at pole z = z,0f X (z)z*!] (2-24) 
i=1 
where Kj, K2, . . . , Km denote the residues of X(z)z*~! at poles z4, z2,..., Zm, respec- 


tively. (For the derivation of this equation, see Appendix B.) In evaluating residues, 
note that if the denominator of X(z)z*'! contains a simple pole z — z; then the 
corresponding residue K is given by 


K = lim[(z — z)X(z)z^] (2-25) 

If X(z)z*"' contains a multiple pole z; of order q, then the residue K is given by 
a 1 . dv " i5 

K- (q — pi lim grille z) X(z)z^"] (2-26) 


Note that the values of k in Equations (2-24), (2-25), and (2-26) are nonnegative 
integer values. 

If X(z) has a zero of order r at the origin, then X(z)z*"! in Equation (2-24) 
will involve a zero of order r + k — 1 at the origin. If r = 1, thenr +k —120 
for k = 0, and there is no pole at z = 0 in X(z)z^^!. However, if r < 0, then there 
will be a pole at z = 0 for one or more nonnegative values of k. In such a case, 
separate inversion of Equation (2-24) is necessary for each such value of k. (See 
Problem A-2-9.) 

It should be noted that the inversion integral method, when evaluated by 
residues, is a very simple technique for obtaining the inverse z transform, provided 
that X(z)z* has no poles at the origin, z = 0. If, however, X(z)z*~' has a simple 
pole or a multiple pole at z = 0, then calculations may become cumbersome and the 
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partial-fraction-expansion method may prove to be simpler to apply. On the other 
hand, in certain problems the partial-fraction-expansion approach may become 
laborious. Then, the inversion integral method proves to be very convenient. 


Example 2-16 

Obtain x(kT) by using the inversion integral method when X(z) is given by 
| z(1- e) 
AG) = (z — 1)\(z - e`") 


Note that 

(1— e *")z* 
(z - Dese 1) 
For k 20,1,2,..., X(z)z*^ ' has two simple poles, z = z, = 1 and z = z =e 
Hence, from Equation (2-24), we have 

(1— e *7)z* 
(z-D(z-e*) 


X(zz*'- 


-aT 


2 


x(k) => [resiaue of 


i=l 


at pole z = «| 


F Ki oF K2 
where 
K, = [residue at simple pole z = 1] 


E Disc desi). elis 
p le DG- De- z d: 


an 


K: 


[residue at simple pole z = e^ 


(1 - Cd | » —akT 


EXE eG Neel 7 


ll 


Hence, 


x(kT) = K, + Ky =1-e°%7, k =0,1,2,... 


Example 2-17 


Obtain the inverse z transform of 


(z — 1)*(z - e *7) 


by using the inversion integral method. 
Notice that 


X(z) = 


k+l 


AE GENCE) 


Fork 20,1,2,..., X(z)z^ ' has a simple pole at z = z, = e^ 
z = z; = 1. Hence, from Equation (2-24), we obtain 


a 


T and a double pole at 


2 


(ky => residue of 


i=l 


k+1 


tA 
Cope at pole z = «| 


=K + K2 
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where 
K, = [residue at simple pole z = e~*7] 
k+1 —a(k*1)T 
_ | _ -aT z £ 
im fe e" G iG- m (le 
K, = [residue at double pole z = 1] 
| 1 ,. d 2 z^ 
“o piz lc DG Pe-e 
d z^ 
= lim z—e' 
_ (k + Dz*(z — e) - z^*! 
lim (z - eT? 
2k _ -l _ 
1- eat (1 — e Ty. 
Hence, 
eg ^T eg kT k eet 
x(kT) = Ki + K: = (-e + Toe ü-ey 
—aT, — goakT 
kT e" (1— e **7) k = 0,1,2, 


2-6 z TRANSFORM METHOD FOR SOLVING 


DIFFERENCE EQUATIONS 


Difference equations can be solved easily by use of a digital computer, provided the 
numerical values of all coefficients and parameters are given. However, closed-form 
expressions for x(k) cannot be obtained from the computer solution, except for very 
special cases. The usefulness of the z transform method is that it enables us to obtain 
the closed-form expression for x(k). 

Consider the linear time-invariant discrete-time system characterized by the 
following linear difference equation: 


x(k) + aix(k — 1) t: + a,x(k — n) 

= bou(k) + biu(k — 1) +--+ + b,u(k — n) (2-27) 
where u(k) and x(k) are the system’s input and output, respectively, at the kth 
iteration. In describing such a difference equation in the z plane, we take the z 


transform of each term in the equation. 
Let us define 


Z[x(k)] = X(z) 
Then x(k + 1), x(k + 2),x(k + 3),...and x(k — 1),x(k — 2),x(k — 3),...can be 
expressed in terms of X(z) and the initial conditions. Their exact z transforms were 
derived in Section 2-4 and are summarized in Table 2-3 for convenient reference. 


Next we present two example problems for solving difference equations by the 
z transform method. 
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TABLE 2-3 z TRANSFORMS OF x(k + m) AND x(k — m) 


z‘ X(z) — z'x(0) — z°x(1) — zx) — zx(3) 
z X(z) - z3x(0) - Zx(1) - zx(2) 


Example 2-18 
Solve the following difference equation by use of the z transform method: 
x(k + 2) + 3x(k + 1) + 2x(k) = 0, x(0) = 0, x(1)=1 


First note that the z transforms of x(k + 2), x(k + 1), and x(k) are given, 
respectively, by 


Z[x(k + 2) = z X(z) - z'x(0) - zx(1) 
Z[x(k + 1)] = zX(z) - zx(0) 
z[x(k)] = X(z) 
Taking the z transforms of both sides of the given difference equation, we obtain 
z? X(z) — zx(0) — zx(1) + 3zX(z) — 3zx(0) + 2X(z) = 0 
Substituting the initial data and simplifying gives 


X(z) = 4——— -——É—-—- Z 
zZ +3z+2 (z+1(z+2) z+1 z+2 


t 1, 
1i-z! 1-42z"! 


Noting that 


onl 1 PEN: onl 1 Lodo 
z hal- D, zZ hl- 2) 


x(k)-(-0*-(-2*5, k=0,1,2,... 


we have 


Example 2-19 
Obtain the solution of the following difference equation in terms of x(0) and x(1): 
x(k + 2) + (a + b)x(k + 1) + abx(k) = 0 


where a and b are constants and k — 0,1,2,.... 
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The z transform of this difference equation can be given by 

[z^ X(z) - z^x(0) — zx(1)] + (a + b)[zX(z) — zx(0)] + abX(z) = 0 

or 
[z^ + (a + b)z + ab]X(z) = [z? + (a + b)z]x(0) + zx(1) 
Solving this last equation for X(z) gives 
XG)- [z * (a + b)z]x(0) + zx(1) 
z+ (a + b)z + ab 

Notice that constants a and b are the negatives of the two roots of the characteristic 
equation. We shall now consider separately two cases: (a) a + b and (b) a = b. 


(a) For the case wherea + b,expanding X(z)/z into partial fractions, we obtain 
X(z) bx(0 *x(1 1 + ax(0) + x(1) 1 


z b-a z+a a-b z+t+b’ a+b 
from which we get 
_ bx(0) + x(1) 1 ax(0) + x(1) 1 
X(z) = b-a liaz a-b 1+ bz 


The inverse z transform of X(z) gives 


x(k) = PO 30), 


where k = 0,1,2,.... 


EO HD py ato 


(b) For the case where a = b, the z transform X(z) becomes 
_ (2? + 2az)x(0) + zx(1) 
B z? + 2az ta 

zx(0)  z[ax(0) + x(1)] 

z+a (z +a) 
_ x(0) + [ax(0) + x(1)]z ^! 
lea! (1 + az y 


X(z) 


The inverse z transform of X(z) gives 
x(k) = x(0)(—a)* + [ax(0) + x())k(-a)", a=b 
where k = 0,1,2,.... 


2-7 CONCLUDING COMMENTS 


In this chapter the basic theory of the z transform method has been presented. The 
z transform serves the same purpose for linear time-invariant discrete-time systems 
as the Laplace transform provides for linear time-invariant continuous-time systems. 

The computer method of analyzing data in discrete time results in difference 
equations. With the z transform method, linear time-invariant difference equations 
can be transformed into algebraic equations. This facilitates the transient response 
analysis of the digital control system. Also, the z transform method allows us to use 
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conventional analysis and design techniques available to analog (continuous-time) 
control systems, such as the root-locus technique. Frequency-response analysis and 
design can be carried out by converting the z plane into the w plane. Also, the 
z-transformed characteristic equation allows us to apply a simple stability test, such 
as the Jury stability criterion. These subjects will be discussed in detail in Chapters 
3 and 4. 


EXAMPLE PROBLEMS AND SOLUTIONS 


Problem A-2-1 
Obtain the z transform of G^, where G is an n X n constant matrix. 


Solution By definition, the z transform of G* is 


Z(G] = X G'z^* 
k=0 
=1+Gz2'+G?z27+@z?t+--: 
-(I-Gz )' 
-(z01-G)'z 
Note that G* can be obtained by taking the inverse z transform of (I — Gz ^!) ' 
or (zI — G) ' z. That is, 
G* = Z [(I1-Gz?)"]-z [GI - G) z] 
Problem A-2-2 
Obtain the z transform of K^. 


Solution By definition, the z transform of k? is 
z[K]-XEzrt*zt-d4z?-9:?-162*-e 
k=0 


=z (1 +27) + 327! + 6274+ 10z * + 157% e) 
2 z (»010tz7) 
| daz yp 
Here we have used the closed-form expression (1 — z ') ^ for the infinite series 
involved in the problem. (See Appendix B.) 
Problem A-2-3 
Obtain the z transform of ka^ ! by two methods. 
Solution 
Method 1. By definition, the z transform of ka"! is given by 
£[ka*] = X ka z * 
k=0 
=z! 4+2az? + 3a°z 7? + 4a°z “t+: 
—-z(1-2az + 3a?z™? + 4a? zz +--+) 
zi 
(1-az^y 
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Method 2. The summation expression for the z transform of ka*^! can also be written 


as follows: 
" és & -k 
Z [ka] = E ka z*-—-a "Dd ka'z*- Dy «(£) 
k=0 k=0 Gy-o Md 
= 1 (zla)! _ z7! 
 a[1- (zla)? (1—azy 
Problem A-2-4 
Show that 
k 
1 
SPEO] -i-z;4XG) 
k-1 z^ 
zz x(h) | = ———4X(G) 
h=0 1-z 
and 
5 x(k) = lim X(z) (2-28) 
k=0 > 
Also show that 
k i-1 
zz «e = alte - Ex(z^ (2-29) 
h-i l-z h=0 


where 1 Sisk —-1. 


Solution Define 
k 


y(k) = È x(h), k = 0,1,2,... 
so that 
y(0) = x(0) 
y(1) = x(0) + x(1) 
y(2) = x(0) + x(1) + xQ) 


y(k) = x(0) + x(1) + x(2) + +--+ + x(k) 
Then, clearly 
y(k) — y(k — 1) = x(k) 


By writing the z transforms of x(k) and y(k) as X(z) and Y(z), respectively, and by 
taking the z transform of this last equation, we have 


Y(z) - z Y(z) = X(z) 
Hence, 


¥(2) = X6) 


or 
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2|3x09]=z0001- YG)-1-g;XG) 
and 
2| Sx] -zp - n - 2 Yo) = ii 5x6) 


By using the final value theorem, we find 


lim y(k) - in| 3 “(| = lim [a - 2n D] 


Or 
X x(h) - Dx = = lim X(z) 


Next, to prove Equation (2-29), first define 
k 
y(k) = Ex(h) = x(i) + x(i + 1) + +- + x(k) 
h-i 
where 1 x i = k — 1. Define also 
X(z) = x(i)z + x(i + 1)z UP +- + x(k)z™ + 


Then, noting that 


E 


X(z) = Z[x(k)] = È x(k)z * = x(0) + x(1)z7' + xz? + 


we obtain 
i-1 


X(z) = X(z) - POM 
Since 
j)-yk-10)-x(Kk) k=i,i+1,i+2,... 
the z transform of this last equation becomes 
Y(z) -z Y(z) = X(z) 
[Note that the z transform of a which begins with k = i, is X(z), not X(z).] Thus, 


z2«w|- Y(z) = — DB - ie - «e| 


Problem A-2-5 


Obtain the z transform of the curve x(t) shown in Figure 2-6. Assume that the sampling 
period T is 1 sec. 


Solution From Figure 2-6 we obtain 


x(0) 20 

x(1) = 0.25 
x(2) = 0.50 
x(3) = 0.75 


x(k)=1, k=4,5,6,... 
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0 1 2 3 4 5 6 7 8 t Figure 2-6 Curve x(t). 


Then the z transform of x(k) can be given by 


co 


X(z) = Ex(k)* 


k=0 


= 0.2527! + 0.502? + 0.752? + z ^e zz +... 


= 0.25(z°' + 277? + 3z74) + 274 


1-z! 
Bra cb LE ME 
4(1— z^) 
lg (tet +z? +z°(1-z 
E -zly 
atz lex) 
4 (1-zy 


Notice that the curve x(t) can be written as 


x(t) = it - à(— 4)1(t — 4) 
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where 1(t — 4) is the unit-step function occurring at t = 4. Since the sampling period 


T = 1 sec, the z transform of x(t) can also be obtained as follows: 


X(z) =Z KA) = Zi] -ZBE - 1 - 4)) 


-i _ GENE M GN 
 4(ü-zy 4(0-zy 
el 2) 

^4 (-zy 

Problem A-2-6 
Consider X(z), where 
22 +z 
*@) 76-20 -1 


Obtain the inverse z transform of X(z). 
Solution We shall expand X(zyz into partial fractions as follows: 


Xz) _ 2z? +1 "EM EE! eae 
z (z-2Y(2-1) (2-2 z-2 z-1 
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Then 


The inverse z transforms of the individual terms give 


-1 


- z - 
Z Tl = k(2*7!), k = 0,1,2,... 
1-227! 


- 1 
fee] 


x(k) = 9k(2*"') -2 +3, =k =0,1,2,... 


>| S51 = x, k =0,1,2,... 


and therefore 


Problem A-2-7 


Obtain the inverse z transform of 


zt2 
(z -2)iz 
Solution Expanding X(z) into partial fractions, we obtain 


X(z) = 


59 


[Note that in this example X(z) involves a double pole at z = 0. Hence the partial 
fraction expansion must include the terms 1/(z’) and 1/z.] By referring to Table 2-1, 


we find the inverse z transform of each term of this last equation. That is, 


-1 k-1 
za] 2 2)27, . k =1,2,3,... 
T kal- 2 k=0 


27-1[,-2] — 1, k = 2 

TE 1- [t k*2 

s-a,- _ J1, k=1 

TE 1-1 k#1 

Hence, the inverse z transform of X(z) can be given by 

0-0-0=0, k=0 

_J1-0-1=0, k=1 

*00715 1-921 k =2 
2*1-0-022*, k =3,4,5, 


Rewriting, we have 


x(k) = 11, 
2*1, k = 3,4,5,... 


To verify this result, the direct division method may be applied to this problem. Noting 


that 
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z+2 z? +227” 
X(z) = (2-22 1-27 


=z? + 4z? + 8274 + 16277% +3276 +- 


= z7? + (275z? + (247z + (257z + (25E + 


we find 

0, k=0,1 

x(k) = 41, k=2 
2*3, ok = 3,4,5, 
Problem A-2-8 
Obtain the inverse z transform of 
—2 
z 
X(z) = G- zy 
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Solution The inverse z transform of z ?/(1 — z ?)? is not available from most z 
transform tables. It is possible, however, to write the given X (z) as a sum of z transforms 
that are commonly available in z transform tables. Since the denominator of X(z) is 
(1 — z^! and the z transform of k? is z "(1 z^ ')/(1 — z '), let us rewrite X(z) as 


z^? z (19z)) z`! 
X(z) 7 a — 7 3 = ü m zy T a m zy 
z' (0*2) z!-z7-*z^? 
(1-z^7y -z 
or 
z^ z (14 z^) z` z”? 


from which we obtain the following partial fraction expansion: 


z? jae tz) z | 


ary"? 


a-z F a-z 


The z transforms of the two terms on the right-hand side of this last equation can be 


found from Table 2-1. Thus, 


z^ 


x(k) eA - Ta - k) = kk -1, k=0,1,2,... 


Q- zy 


It is noted that if the given X(z) is expanded into other partial fractions then the 


inverse z transform may not be obtained. 


As an alternative approach, the inverse z transform of X(z) may be obtained by 


use of the inversion integral method. First, note that 


k 


k-1 _ _ 2 
X(z)z TES 
Hence, for k = 0,1,2,..., X(z)z^ ' has a triple pole at z = 1. Referring to Equation 
(2-24), we have 
. z‘ . 
x(k) = residue of G - 1» at triple pole z — | 
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2 1 , d _ 43. z* 
MERETET E Dg- =| 


EET d a 
mg ) 


= 1; Dqy2 
= glim[k(k — 1)7^77] 


= Fk(k 1) k =0,1,2,... 


Problem A-2-9 
Using the inversion integral method, obtain the inverse z transform of 
10 
XO = Gaye J 
Solution Note that 
10z^' 
k-1 NE 
Xe» -G-)56G-2 
For k = 0, notice that X(z)z* ! becomes 
X(z)z 1 = _—__10_ k=0 


(z — 1)(z ~- 2)z’ 


Hence, for k = 0, X(z)z*~' has three simple poles, z = z; = 1, z = z2 = 2, and z = 


z, = 0. Fork = 1,2,3,..., however, X(z)z* ! has only two simple poles, z = zi = 1 
and z = z; = 2. Therefore, we must consider x(0) and x(k) (where k = 1,2,3,...) 
separately. 


Fork = 0. For this case, referring to Equation (2-24), we have 
3 
. 10 B 
x(0) = z residue of G-1)G-2z at pole z — «| 
= Kı + K2 + K, 
where 


K, = [residue at simple pole z = 1] 


. 10 
= imle i Dc - D - x = -10 


K; = [residue at simple pole z = 2] 


; 10 
-mle - oue] 


K; — [residue at simple pole z — 0] 


. 10 
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Hence, 
x(0 = K, + Ko + K; = -10+5+5=0 
Fork = 1,2,3,.... For this case, Equation (2-24) becomes 
Z 102^ 
x(k) = > reste of GDE- J at pole z = «| 
= Ki + Ky 
where 
K; = [residue at simple pole z = 1] 
= ine re ecu] 
K; = [residue at simple pole z = 2] 
LN 
Thus, 


x(k) = Ki + Ky = -10-100*) 2102 — 1), k-12,3,... 


Hence, the inverse z transform of the given X(z) can be written 


..J0, k-0 
x(k) = [Go -1, k-212,,... 


An alternative way to write x(k) for k = 0 is 
x(k) = 58(k) + 10(2^! — 1), k =0,1,2,... 
where 8)(k) is the Kronecker delta function and is given by 


_ fil, fork =0 
5) = [o for k #0 


Problem A-2-10 
Obtain the inverse z transform of 


_ z(z + 2) 
|(-1y 


by use of the four methods presented in Section 2-5. 


X(z) 


Solution 
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(2-30) 


Method 1: Direct division method. We first rewrite X(z) as a ratio of two polynomials 


inz 


Dividing the numerator by the denominator, we get 
X(z) = 1 + 4z *7z ?ó c 102 2 o 
Hence, 


x(0) =1 
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x(1) =4 
x(2) =7 


x(3) = 10 


Method 2: Computational method (MATLAB approach). X(z) can be written as 


z? + 2z 


XG) en EU 


Hence, the inverse z transform of X(z) can be obtained with MATLAB as follows: 
Define 


num —-[1 2 OJ 
den={1 -2 1] 


If the values of x(k) for k = 0,1,2,...,30 are desired, then enter the Kronecker delta 
input as follows: 


u = [1 zeros(1,30)] 
Then enter the command 
x = filter(num,den,u) 


See MATLAB Program 2-3. [The screen will show the output x(k) from k = 0 to 
k = 30.] (MATLAB computations begin from column 1 and end at column 31, rather 


MATLAB Program 2-3  - 


num s [1. 2.0]; 
denz[1 -2 1); 
us [1° zeros(1,30)]; 
x = filterínum,den;u) 


x Lj 
Columns 1 through 12 


1 4 7 10 13 16 19 22 


Columns 13 through 24 


37 40 43 46 49 52 55 58 
Columns 25 through 31 


73 76 79 82 85 88 91 
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than from column 0 to column 30.) The values x(k) give the inverse z transform of X(z). 


That is, 
x(0) = 1 
x(1) 24 
x(2) =7 
x(30) = 91 


Method 3: Partial-fraction-expansion method. We expand X(z) into the following 
partial fractions: 


_ 2(z +2) _ 3z i 3z7 zo 
eS lte- z1 eee p 


Then, noting that 


X(z) 


we obtain 
x(0) = 1 
x(k) = 3k + 1, k = 1,2,3,... 
which can be combined into one equation as follows: 
x(k) = 3k + 1, k =0,1,2,... 
Note that if we expand X(z) into the following partial fractions 


4 3 4271 3z? 
tomas = 1 +m H aM 
z-1 (z-1y : 1-z" (1-zy 


then the inverse z transform of X(z) becomes 
x(0) 21 
x(k) =4+3(k -1)=3k+1,  Á k-2123.. 


X(z}=1+ 


Or 
x(k)-3k*1, k=0,1,2,... 


which is the same as the result obtained by expanding X(z) into the other partial 
fractions. [Remember that X(z) can be expanded into different partial fractions, but 
the final result for the inverse z transform is the same.] 


Method 4: Inversion integral method. First, note that 


NR 2)z* 


X(z)z^" (z - 1)? 


me 
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Fork = 0,1,2,..., X(z)z* ' has a double pole at z = 1. Hence, referring to Equation 
(2-24), we have 


k 
x(k) = residue of ax at double pole z = | 


Thus, 


1 . d a(z + 2)z* 
x(k) = 5 lima; le - D le - x 


- lim. [e + 2)z*] 


zl 
= 3k + 1, k = 0,1,2,... 
Problem A-2-11 
Solve the following difference equation: 
2x(k) — 2x(k — 1) + x(k — 2) = u(k) 
where x(k) = 0 for k « 0 and 


1 k=0,1,2,... 
we =f} k«0 


Solution By taking the z transform of the given difference equation, 


2X(z) -2z ! X(z) + z ?^X(z) = Tor 


Solving this last equation for X(z), we obtain 
1 1 z 
XG) = 1—-z2'2-22! +27 (z-1)Qz-2z-41) 
Expanding X(z) into partial fractions, we get 
z -z +z 1 -1 +z 
t3225, * To tT 
z-1 2z°-2z+1 1-z 2-22 +z 


X(z) = 


Notice that the two poles involved in the quadratic term in this last equation are complex 
conjugates. Hence, we rewrite X(z) as follows: 


1 1 1-052 1057 


)-z5 21-z'-«05z? 21-z!-0.5z^? 


By referring to the formulas for the z transforms of damped cosine and damped sine 
functions, we identify e 7^" = 0.5 and cos wT = 1/V2 for this problem. Hence, we get 
wT = míA,sinoT = 1/v2, and e^7* = 1/V2. Then the inverse z transform of X (z) can 
be written as 


x(k) = 1 — 1e "*" cos okT + 1e 7* sin wkT 


k k 
if1 kn 1(1\ kr . 
- A) cost CL sin 4" k =0,1,2,... 


from which we obtain 


X(z) = 
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x(2) = 1.25 
x(3) = 1.25 


x(4) = 1.125 


Problem A-2-12 
Consider the difference equation 
x(k + 2) — 1.3679x(k + 1)  0.3679x(k) = 0.3679u(k + 1) + 0.2642u(k) 
where x(k) is the output and x(k) = 0 for k = 0 and where u(k) is the input and is 


given by 
u(k) = 0, k«0 
u(0) = 1 
u(1) = 0.2142 
u(2) = -0.2142 


u(k) = 0, k = 3,4,5,... 
Determine the output x(k). 


Solution Taking the z transform of the given difference equation, we obtain 
[z X(z) — z^ x(0) — zx(1)] — 1.3679[zX(z) — zx(0)] + 0.3679X(z) 

= 0.3679[zU(z) — zu(0)] + 0.2642U(z) (2-31) 
By substituting k = —1 into the given difference equation, we find 

x(1) — 1.3679x (0) + 0.3679x(—1) = 0.3679u(0) + 0.2642u(—1) 
Since x(0) = x(—1) = 0 and since u(—1) = 0 and u(0) = 1, we obtain 
x(1) = 0.3679u(0) = 0.3679 
By substituting the initial data 
x(0)=0,  x(1)- 0.3679, u(0) = 1 
into Equation (2-31), we get 
z” X(z) — 0.3679z — 1.3679z X(z) + 0.3679 X (z) 
= 0.3679z U(z) — 0.3679z + 0.2642U(z) 

Solving for X(z), we find 


0.3679z + 0.2642 


XG) = 73 13679: + 0.3679 


U(z) 


The z transform of the input u(k) is 


U(z) = Z [u(k)] = 1 + 0.214227! — 0.21422 ? 
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Hence, 


X(z) = 0.3679z + 0.2642 
z^ — 1.3679z + 0.3679 


_ 0.3679z ^! + 0.3430z 7? — 0.02221z ? — 0.05659z~* 
1 — 1.367927" + 0.36797 ? 


= 0.367927! + 0.84632 7+ 23+ 2744+ z ee 


(1 + 0.2142z-* — 0.2142z ?) 


Thus, the inverse z transform of X(z) gives 


x(0) =0 
x(1) = 0.3679 
x(2) = 0.8463 


x(k) = 1, k =3,4,5,... 
Problem A-2-13 
Consider the difference equation 
x(k + 2) = x(k + 1) + x(k) 


where x(0) = 0 and x(1) = 1. Note that x(2) = 1,x(3) = 2,x(4) = 3,.... The series 
0,1,1,2,3,5,8,13,... is known as the Fibonacci series. Obtain the general solution 
x(k) in a closed form. Show that the limiting value of x(k + 1)/x(k) as k approaches 
infinity is (1 + V5)/2, or approximately 1.6180. 


Solution By taking the z transform of this difference equation, we obtain 
z^ X(z) — 27x(0) — zx(1) = zX(z) — zx(0) + X(z) 
Solving for X(z) gives 


= 2°x(0) + zx(1) ~ zx(0) 


X(z) z —-z—1 


By substituting the initial data x(0) = 0 and x(1) = 1 into this last equation, we have 


y4 
XO = 3—7;-1 
stf Z 0 22 _ 
V5 14 V5 1- V5 
zZz — — z> 
2 2 
atJ t o 1 Z 
V5 14 V5 , 1- V5 4 
1- 2 z 1- 2 z 


The inverse z transform of X(z) is 


1|[(14 VsY f1-~v5\* 
«e «A 2 | -( 5 J| k =0,1,2,... 


Note that although this last equation involves V5 the square roots in the right-hand side 
of this last equation cancel out, and the values of x(k) for k = 0,1,2,... turn out to 
be positive integers. 
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The limiting value of x(k + 1)/x(k) as k approaches infinity is obtained as follows: 


( + VT » ( e: v 
2 2 


x(k + 1) 


lim ————- = lim ——_> oo 
ew x(k) — 0 (1evsY (1 - V5\ 
2 2 
Since |(1 — V5)/2| < 1, 
k 
lim (2 = xj 0 
kw 2 
Hence, 
k 4VSYU 
tim 2K +1) — 2 - IS VS 2G eB 
kom x(k) bows ( + M 2 
2 


Problem A-2-14 


Referring to Problem A-2-13, write a MATLAB program to generate the Fibonacci 
series. Carry out the Fibonacci series to k = 30. 


Solution The z transform of the difference equation 
x(k + 2) = x(k + 1) + x(k) 
is given by 
z^ X(z) — z?x(0) — zx(1) = zX(z) — zx(0) + X(z) 


Solving this equation for X(z) and substituting the initial data x(0) = 0 and x(1) = 1, 
we get 


z 


MOG EEEE 


The inverse z transform of X(z) will give the Fibonacci series. 


To get the inverse z transform of X(z), obtain the response of this system to the 
Kronecker delta input. MATLAB Program 2-4 will yield the Fibonacci series. 


: MATLAR Program 2-4 


a- Fibonacci series -i-r 


"The Fibonacci series can be generated asthe —— 
6 response. of X(z) to the Kronecker delta CHEN where - 


Rd a^- -z- uo 


^ue[l zers(30] ——— 
x= filter(num,den, u) 


Chap. 2 Example Problems and Solutions 69 
The filtered output y shown next gives the Fibonacci series. 
x- 

Columns 1 through 6 
0 1 

Columns 7 through 12 
8 13 

Columns 13 through 18 


144 233 


Columns 19 through 24 


2584 4181 6765 10946 17711 
Columns 25 through 30 
46368 75025 121393 196418 317811 514229 
Column 31 


832040 


Note that column 1 corresponds to k = 0 and column 31 corresponds to k = 30. The 
Fibonacci series is given by 


x(0) — 0 
x(1) =1 
x(2) =1 
x(3) =2 
x(4) =3 


x(5)=5 


x(29) = 514,229 
x(30) = 832,040 
Problem A-2-15 
Consider the difference equation 


x(k + 2) + ax(k + 1) + Bx(k) - 0 (2-32) 
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71 Figure 2-7 Region in the af plane in 
which the solution series of Equation 
(2-32), subjected to initial conditions, is 
finite. 


Find the conditions on @ and f for which the solution series x(k) for k = 0,1,2,..., 
subjected to initial conditions, is finite. 
Solution Let us define 

a=atb, B = ab 


Then, referring to Example 2-19, the solution x(k) for k = 0,1,2, ... can be given by 


bx(0) + x(1) (-a)* + 2x0) * x0) (-by, a+ b 


x(k) = b-a 
x(0)(-a)* + [ax(0) + x(1)]k(—-a)*", a=b 
The solution series x(k) for k = 0,1,2,..., subjected to initial conditions x(0) and 


x(1), is finite if the absolute values of a and b are less than unity. Thus, on the o plane, 
three critical points can be located: 


a=W, 


The interior of the region bounded by lines connecting these points satisfies the con- 
dition |a| < 1,|b| < 1. The boundary lines can be given by B = 1, a — B = 1, and 
a+ B = —1. See Figure 2-7. If point (a, B) lies inside the shaded triangular region, 
then the solution series x(k) fork = 0,1,2,..., subjected to initial conditions x(0) and 
x(1), is finite. 


PROBLEMS 


Problem B-2-1 


Obtain the z transform of 
"T 
x(t) = z (1— e) 


where a is a constant. 


Chap. 2 Problems 


Problem B—2-2 
Obtain the z transform of k’. 


Problem B-2-3 
Obtain the z transform of t?e 


—at 


Problem B-2-4 
Obtain the z transform of the following x(k): 


x(k)99kQ*) — 2 +3, k& =0,1,2,... 
Assume that x(k) = 0 for k < 0. 


Problem B-2-5 


Find the z transform of 
k 
x(k) = >a" 
h=0 


where a is a constant. 


Problem B-2-6 
Show that 
: L 1)\9*-21 = (2!)z 
Z [k(k 1) ] (z = ay 
dc xe ep (ANZ 
Z[k(k — 1): (k - h + Da] G ay” 
Problem B-2-7 


Obtain the z transform of the curve x(t) shown in Figure 2-8. 


x(t) 

1.0 SS 
| 
i 
i 

0.5 : 
| 
l 
I 

0 1 2 3 4 5 6 7 8 
Figure 2-8 Curve x(t). 
Problem B-2-8 


Obtain the inverse z transform of 


1 + 2z + 32? + Az? + 52^ 
X(z) = z^ 
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Problem B-2-9 
Find the inverse z transform of 
z (0.5 — z7’) 
(1 - 0.5z (1 - 0.8277)? 


Use (1) the partial-fraction-expansion method and (2) the MATLAB method. Write 
a MATLAB program for finding x(k), the inverse z transform of X(z). 


X(z) = 


Problem B-2-10 

Given the z transform 
NET wu 
(1 — 27) + 1.3z! + Q.4z ?) 


determine the initial and final values of x(k). Also find x(k), the inverse z transform 
of X(z), in a closed form. 


X(z) = 


Problem B-2-11 
Obtain the inverse z transform of 
1t*z!-z7? 
X(z) = ————— 
(z) feet 
Use (1) the inversion integral method and (2) the MATLAB method. 


Problem B-2-12 
Obtain the inverse z transform of 


Z3 


fO -q-7580-92:5 


in a closed form. 


Problem B-2-13 
By using the inversion integral method, obtain the inverse z transform of 


lt6z2?4z? 
XO = 077750-0277) 
Problem B-2-14 
Find the inverse z transform of 
z (1—z7?) 
(1 zy 
Use (1) the direct division method and (2) the MATLAB method. 


X(z) = 


Problem B—2-15 
Obtain the inverse z transform of 


. 0.36827 + 0.478z + 0.154 


AG) 2-02 


by use of the inversion integral method. 
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Problem B-2-16 
Find the solution of the following difference equation: 
x(k + 2) — 1.3x(k + 1) + 0.4x(k) = u(k) 


where x(0) = x(1) = 0 and x(k) = 0 for k < 0. For the input function u(k), consider 
the following two cases: 


_fi, k-912... 
«9 - [s k «0 


and 
u(0) = 1 
u(k) = 0, k #0 
Solve this problem both analytically and computationally with MATLAB. 
Problem B—2-17 
Solve the following difference equation: 
x(k + 2) — x(k + 1) + 0.25x(K) = u(k + 2) 
where x(0) = 1 and x(1) = 2. The input function u(k) is given by 
u(k)=1, k=0,1,2,... 
Solve this problem both analytically and computationally with MATLAB. 
Problem B-2-18 
Consider the difference equation: 
x(k + 2) — 1.3679x(k + 1) + 0.3679x(k) = 0.3679u(k + 1) + 0.2642u(k) 
where x(k) = 0 for k = 0. The input u(k) is given by 
u(k) = 0, k<0 
u(0) = 1.5820 
u(1) = —0.5820 
u(k) = 0, k =2,3,4,... 


Determine the output x(k). Solve this problem both analytically and computationally 
with MATLAB. 
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z-Plane Analysis 
of Discrete-Time 
Control Systems 


3-7 INTRODUCTION 


The z transform method is particularly useful for analyzing and designing single- 
input-single-output linear time-invariant discrete-time control systems. This chapter 
presents background material necessary for the analysis and design of discrete-time 
control systems in the z plane. The main advantage of the z transform method is that 
it enables the engineer to apply conventional continuous-time design methods to 
discrete-time systems that may be partly discrete time and partly continuous time. 

Throughout this book we assume that the sampling operation is uniform; that 
is, only one sampling rate exists in the system and the sampling period is constant. 
If a discrete-time control system involves two or more samplers in the system, we 
assume that all samplers are synchronized and have the same sampling rate or 
sampling frequency. 


Outline of the Chapter. The outline of this chapter is as follows. Section 3-1 
gives introductory remarks. Section 3-2 presents a method to treat the sampling 
operation as a mathematical representation of the operation of taking samples x(kT) 
from a continuous-time signal x(t) by impulse modulation. This section includes 
derivations of the transfer functions of the zero-order hold and first-order hold. 

Section 3-3 deals with the convolution integral method for obtaining the z 
transform. Reconstructing the original continuous-time signal from the sampled 
signal is the main subject matter of Section 3-4. Based on the fact that the Laplace 
transform of the sampled signal is periodic, we present the sampling theorem. 
Section 3-5 discusses the pulse transfer function. Mathematical modeling of digital 
controllers in terms of pulse transfer functions is discussed. Section 3—6 treats the 
realization of digital controllers and digital filters. 
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3-2 IMPULSE SAMPLING AND DATA HOLD 


Discrete-time control systems may operate partly in discrete time and partly in 
continuous time. Thus, in such control systems some signals appear as discrete-time 
functions (often in the form of a sequence of numbers or a numerical code) and other 
signals as continuous-time functions. In analyzing discrete-time control systems, the 
z transform theory plays an important role. To see why the z transform method is 
useful in the analysis of discrete-time control systems, we first introduce the concept 
of impulse sampling and then discuss data hold. 


Impulse Sampling. We shall consider a fictitious sampler commonly called an 
impulse sampler. The output of this sampler is considered to be a train of impulses 
that begins with ¢ = 0, with the sampling period equal to T and the strength of each 
impulse equal to the sampled value of the continuous-time signal at the cor- 
responding sampling instant. A pictorial diagram of the impulse sampler is shown 
in Figure 3—1. [We assume x(t) = 0 for t < 0.] (Since, mathematically, an impulse 
is defined as having an infinite amplitude with zero width, it is graphically repre- 
sented by an arrow with an amplitude representing the strength of impulse.) 

The impulse-sampled output is a sequence of impulses, with the strength of 
each impulse equal to the magnitude of x(t) at the corresponding instant of time. 
[That is, at time ¢ = kT, the impulse is x(kT)ó(t — kT). Note that 6(t — kT) = 0 
unless t = KT.] We shall use the notation x*(t) to represent the impulse-sampled 
output. The sampled signal x" (t), a train of impulses, can thus be represented by the 
infinite summation 


oo 


x*(t) = E x(kT)8(t — kT) 


k=0 
or 

x* (t) = x(O)5(t) + x(T)6(t — T) +--+ + x(kT)é(t — kT) + --- (3-1) 
We shall define a train of unit impulses as 6;(t), or 

ôr(t) = È S(t — kT) 
k=0 

The sampler output is equal to the product of the continuous-time input x(t) and the 
train of unit impulses 6;(t). Consequently, the sampler may be considered a modu- 


lator with the input x(¢) as the modulating signal and the train of unit impulses 5,(t) 
as the carrier, as shown in Figure 3-2. 


x(t) x*(t) 


Xs) ôr X*(s) Figure 3-1 Impulse sampler. 
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Carrier 


x(t) 1 i 
Modulating | 

signal | 
1 


Ll — - — - — - — 


Figure 3-2 Impulse sampler as a modulator. 


Next, consider the Laplace transform of Equation (3-1): 
X* (s) = s[x*(0] = xL] + x(T)L[S(t — T)] 
+x(2T)£[S(t - 27)] + --- 
= x(0) + x(T)e ^ + x QT)e 7^  ..- 


= 5 x(kT)e "* (3-2) 


Notice that if we define 


or 


then Equation (3-2) becomes 


X*(s) = X x(kT)2* (3-3) 


s-(I/T) inz 
The right-hand side of Equation (3-3) is exactly the same as the right-hand side of 
Equation (2-1): It is the z transform of the sequence x(0), x(T), x(2T), . . . , gener- 
ated from x(t) at t = kT, where k = 0,1,2,.... Hence we may write 


xo), = X(z) 


-(VT) inz 


and Equation (3-3) becomes 


X*(8)| sanm: = A” ( In z) = X(z) = Zx(kT)z* (3-4) 
k=0 
Note that the variable z is a complex variable and T is the sampling period. [It should 
be stressed that the notation X(z) does not signify X(s) with s replaced by z, but 
rather X*(s = T! Inz).] 
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Summary. Let us summarize what we have just stated. If the continuous-time 
signal x(t) is impulse sampled in a periodic manner, mathematically the sampled 
signal may be represented by 


x*(t) = È x(t)&(t — kT) 
k=0 

In the impulse sampler the switch may be thought of as closing instantaneously every 
sampling period T and generating impulses x(kT)8(t — kT). Such a sampling pro- 
cess is called impulse sampling. The impulse sampler is introduced for mathematical 
convenience; it is a fictitious sampler and it does not exist in the real world. 

The Laplace transform of the impulse-sampled signal x* (t) has been shown to 
be the same as the z transform of signal x(t) if e" is defined as z, or e? = z. 


Data-Hold Circuits. | In a conventional sampler, a switch closes to admit an 
input signal every sampling period T. In practice, the sampling duration is very short 
in comparison with the most significant time constant of the plant. A sampler 
converts a continuous-time signal into a train of pulses occurring at the sampling 
instants t = 0, T, 2T,... , where T is the sampling period. (Note that between any 
two consecutive sampling instants the sampler transmits no information. Two signals 
whose respective values at the sampling instants are equal will give rise to the same 
sampled signal.) 

Data-hold is a process of generating a continuous-time signal A(t) from a 
discrete-time sequence x(kT). A hold circuit converts the sampled signal into a 
continuous-time signal, which approximately reproduces the signal applied to the 
sampler. The signal h(t) during the time interval kT = t < (k + 1)T may be approx- 
imated by a polynomial in 7 as follows: 


h(kT + 7) = a.v + a, 1" | + °° t aT a (3-5) 
where 0 = 7 < T. Note that signal h(kT) must equal x(kT), or 
h(kT) = x(kT) 
Hence, Equation (3—5) can be written as follows: 
h(kT + 7) = aT" + a, T" + t aum + x(KT) (3-6) 


If the data-hold circuit is an nth-order polynomial extrapolator, it is called an 
nth-order hold. Thus, if n = 1, it is called a first-order hold. [The nth-order hold 
uses the past n + 1 discrete data x((k — n)T),x((k — n + 1)T),..., x(kT) to gen- 
erate a signal A(kT + 7).] 

Because a higher-order hold uses past samples to extrapolate a continuous- 
time signal between the present sampling instant and the next sampling instant, the 
accuracy of approximating the continuous-time signal improves as the number of 
past samples used is increased. However, this better accuracy is obtained at the cost 
of a greater time delay. In closed-loop control systems, any added time delay in the 
loop will decrease the stability of the system and in some cases may even cause system 
instability. 

The simplest data-hold is obtained when n = 0 in Equation (3—6), that is, when 


h(kT + 7) = x(kT) (3-7) 
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x(t} X(kT) A(t) 


Pa Zero-order 


x(t) Sampler x(kT) hold Alt} 
Figure 3-3 Sampler and zero-order hold. 
where 0 = 7 < Tand k = 0,1,2,.... Equation (3-7) implies that the circuit holds 


the amplitude of the sample from one sampling instant to the next. Such a data-hold 
is called a zero-order hold, or clamper, or staircase generator. The output of the 
zero-order hold is a staircase function. In this book, unless otherwise stated, we 
assume that the hold circuit is of zero order. 

It will be seen later that the transfer function G, of the zero-order hold may 
be given by 


Zero-Order Hold. Figure 3-3 shows a sampler and a zero-order hold. The 
input signal x(t) is sampled at discrete instants and the sampled signal is passed 
through the zero-order hold. The zero-order hold circuit smoothes the sampled 
signal to produce the signal A(t), which is constant from the last sampled value until 
the next sample is available. That is, 


h(kT +t)=x(kT), for0<t<T (3-8) 


We shall obtain a mathematical model of the combination of a real sampler and 
zero-order circuit, as shown in Figure 3—4(a). Utilizing the fact that the integral of 
an impulse function is a constant, we may assume that the zero-order hold is an 
integrator, and the input to the zero-order hold circuit is a train of impulses. Then 
a mathematical model for the real sampler and zero-order hold may be constructed 
as shown in Figure 3—4(b), where Gy (s) is the transfer function of the zero-order 
hold and x* (t) is the impulse sampled signal of x(t). 


hold 


x(t) ~~ xn hit) 
T 


xi 7 x*(t) hatt) Figure 3-4 (a) A real sampler and 
ho 


Hs) zero-order hold; (b) mathematical 
? model that consists of an impulse 
(b) sampler and transfer function G,(s). 


Sec. 3-2 Impulse Sampling and Data Hold 79 
Consider the sampler and zero-order hold shown in Figure 3—4(a). Assume 
that the signal x(¢) is zero for t < 0. Then the output /,(f) is related to x(t) as follows: 
ht) = xO - 16 — T)] + x(D)1G - T) - 1t - 2T)] 
+x(2T)[1(t — 2T) - 1((- 3T) ++ 


= Mx(kT)[1(t — kT) — 1(t — (k + 1)T)] (3-9) 
k=0 
Since 
e 5 
gilt — kT)] = s 
the Laplace transform of Equation (3-9) becomes 
» e kts — e (kt Ts 
Lhi(t)] = Hi) = È x(kT) — — —— 
k=0 
l-e’s ~KT. 
= ÉL YN x(kT)e (3-10) 
s k=0 


Next, consider the mathematical model shown in Figure 3-4(b). The output 
of this model must be the same as that of the real zero-order hold, or 


L£{h,(t)] = HXs) = His) 


Thus, 
1 — p» 7? 
H,(s) = Y x(kT)e^* (3-11) 
k=0 
From Figure 3—4(b), we have 
H,(s) = Gy(s)X* (s) (3-12) 


Since 


oo 


X*(s) = E x(kT)e "^ 


k=0 
Equation (3-11) may be written as 
1 — 


H,(s) = F 


e 5 
X*(s) (3-13) 
By comparing Equations (3-12) and (3-13), we see that the transfer function of the 
zero-order hold may be given by 
1-e^ 


S 


Grols ) = 


Note that, mathematically, the system shown in Figure 3—4(a) is equivalent to the 
system shown in Figure 3-4(b) from the viewpoint of the input-output relationship. 
That is, a real sampler and zero-order hold can be replaced by a mathematically 
equivalent continuous-time system that consists of an impulse sampler and a transfer 


80 z-Plane Analysis of Discrete-Time Control Systems Chap. 3 


function (1 — e~”)/s. The two sampling processes will be distinguished (as they are 
in Figure 3-4) by the manner in which the sampling switches are drawn. 


Transfer Function of First-Order Hold. Although we do not use first-order 
holds in control systems, it is worthwhile to see what the transfer function of 
first-order holds may look like. We shall show that the transfer function of the 
first-order hold may be given by 


1-ePYTs +1 
G(s) = A=") mE (3-14) 


Next we shall derive Equation (3-14). 

We have stated that Equation (3—6) describes the output of an nth-order hold 
circuit. For the first-order hold, n = 1. Let us substitute n = 1 into Equation (3-6). 
Then we have 


h(kT + 7) =ar + x(kT) (3-15) 
where 0 = 7 < T and k = 0,1,2,.... By applying the condition that 
h((k — 1)T) = x((k — 1)T) 
the constant a, can be determined as follows: 
h((k — 1)T) = -aT + x(kT) = x((k — 1)T) 
Or 


= X(KT) - x((k — DT) 
-— T 


Hence, Equation (3-15) becomes 


AET + 1) = xxr) + ED DD, 


(3-16) 
where 0 = 7 < T. The extrapolation process of the first-order hold is based on 


Equation (3-16). The continuous-time output signal A(t) obtained by use of the 
first-order hold is a piecewise-linear signal, as shown in Figure 3-5. 


x(kT) 


o T 2T 3T t -T 0 T 2T 3T t 


First-order 
hold 


Figure 3-5 Input and output of a first-order hold. 
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To derive the transfer function of the first-order hold circuit, it is convenient 
to assume a simple function for x(t). For example, a unit-step function, a unit- 
impulse function, and a unit-ramp function are good choices for x(t). 

Suppose that we choose a unit-step function as x (t). Then, for the real sampler 
and first-order hold shown in Figure 3—6(a), the output A(t) of the first-order hold 
consists of straight lines that are extrapolations of the two preceding sampled values. 
The output (ft) is shown in the diagram. The output curve h(t) may be written as 
follows: 


«o =(1+ io - i 0-167 n 


The Laplace transform of this last equation becomes 


(3-17) 


x(t) x(kT) 


First-order 


x(t) hold 


(a) 


hit) 


(b) 


Figure 3-6 (a) Real sampler cascaded with first-order hold; (b) mathematical model 
consisting of impulse sampler and G,,(s). 
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Figure 3-6(b) shows a mathematical model of the real sampler cascaded with 
the first-order hold shown in Figure 3-6(a). The mathematical model consists of the 
impulse sampler and G,,(s), the transfer function of the first-order hold. The out- 
put signal of this model is the same as the output of the real system. Hence, the 
output H(s) is also given by Equation (3-17). 
The Laplace transform of the input x*(t) to the first-order hold G,,(s) is 
1 


X*G) = È kT) e = In 


Hence, the transfer function G,,(s) of the first-order hold is given by 


H(s) 4 |.nols*1 
X* (s) n (1 e ) Ts? 


4 ( B e| Ts +1 
S T 


Note that a real sampler combined with a first-order hold is equivalent to an impulse 
sampler combined with a transfer function (1 — e~™)*(Ts + 1)/(Ts?). 

Similarly, transfer functions of higher-order hold circuits may be derived by 
following the procedure presented. However, since higher-order hold circuits (n = 2) 
are not practical from the viewpoint of delay (which may cause system instability) 
and noise effects, we shall not derive their transfer functions here. (The zero-order 
hold is the simplest and is used most frequently in practice.) 


Gyi(s) ri 


Summary. Let us summarize what we have presented so far about impulse 
sampling. 


1. A real sampler samples the input signal periodically and produces a sequence 
of pulses as the output. While the sampling duration (pulse width) of the real 
sampler is very small (but will never become zero), the assumption of zero 
width, which implies that a sequence of pulses becomes a sequence of impulses 
whose strengths are equal to the continuous-time signal at the sampling in- 
stants, simplifies the analysis of discrete-time systems. Such an assumption is 
valid if the sampling duration is very small compared with the significant time 
constant of the system and if a hold circuit is connected to the output of the 
sampler. 


2. When we transform e” to z, the concept of impulse sampling (which is purely 
a mathematical process) enables us to analyze by the z transform method 
discrete-time control systems that involve samplers and hold circuits. This 
means that by use of the complex variable z the techniques developed for the 
Laplace transform methods can be readily applied to analyze discrete-time 
systems involving sampling operations. 


3. As pointed out earlier, once the real sampler and zero-order hold are mathe- 
matically replaced by the impulse sampler and transfer function (1 — e "5y/s, 
the system becomes a continuous-time system. This simplifies the analysis of 
the discrete-time control system, since we may apply the techniques available 
to continuous-time control systems. 
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4. Itis repeated that the impulse sampler is a fictitious sampler introduced purely 
for the purpose of mathematical analysis. It is not possible to physically 
implement such a sampler that generates impulses. 


3-3 OBTAINING THE z TRANSFORM BY THE CONVOLUTION 
INTEGRAL METHOD 


In this section we shall obtain the z transform of x(t) by using the convolution integral 
method. 

Consider the impulse sampler shown in Figure 3-7. The output of the impulse 
sampler is 


æ% 


x*(t) = > x8 — kT) = x(t) Y é(t — kT) (3-18) 


k=0 
Noting that 
LJE — kT)] = e ** 


we have 


8 


i 


a(t — en| =LteB+e%4+ 2318 p... — = 
ò l-e 


It 


Since 
X*(s) = L[x*(t)] = skO 3 a = er) 


we see that X* (s) is the Laplace transform of the product of two time functions, x(t) 
and Xz- 6(t — kT). Note that it is not equal to the product of the two corresponding 
Laplace transforms. 

The Laplace transform of the product of two Laplace-transformable functions 
f(t) and g(t) can be given by 


HOSO = | Feat 


1 fem 


Sonia SEPAR (3-19) 


[For the derivation of Equation (3-19), see Problem A-3-4.] 
Let us substitute x(t) and Y-o6(t — kT) for f(t) and g(t), respectively. Then 
the Laplace transform of X* (s), where 


X*(s)- gO - e| 


x(t) d x* (t) 
—————M— 


ôr Figure 3-7 Impulse sampler. 


84 z-Plane Analysis of Discrete-Time Control Systems Chap. 3 


can be given by 


X*(s) = sfo > &(t — en| 


S cs 20 

7 Xx. SPT emend (3-20) 
where the integration is along the line from c — jo toc + j% and this line is parallel 
to the imaginary axis in the p plane and separates the poles of X( p) from those of 
1/[1 — e776-?]. Equation (3-20) is the convolution integral. It is a well-known fact 
that such an integral can be evaluated in terms of residues by forming a closed 
contour consisting of the line from c — jo to c + jo and a semicircle of infinite radius 
in the left or right half-plane, provided that the integral along the added semicircle 
is a constant (zero or a nonzero constant). That is, we rewrite Equation (3-20) as 
follows: 


1 [e 1 
X*(s) = ie EM 


X X 
B =fr ie i a 1- ene ey 
where T is a semicircle of infinite radius in the left or right half p plane. 

There are two ways to evaluate this integral (one using an infinite semicircle 
in the left-half plane and the other an infinite semicircle in the right half-plane); we 
shall describe the results obtained by the two cases separately. 

In our analysis here, we assume that the poles of X(s) lie in the left half-plane 
and that X(s) can be expressed as a ratio of polynomials in s, or 


where q(s) and p(s) are polynomials in s. We also assume that p(s) is of a higher 
degree in s than q(s), which means that 


lim X(s) = 0 
Evaluation of the Convolution Integral in the Left Half-Plane. We shall evalu- 
ate the convolution integral given by Equation (3-21) using a closed contour in the 
left half of the p plane as shown in Figure 3-8. Using this closed contour, Equation 


(3-21) may be evaluated as follows: Noting that the denominator of X(s) is of higher 
degree in s than the numerator, the integral along T; vanishes. Hence, 


Ald X(p) 
Ae Qa 1- etn? 


This integral is equal to the sum of the residues of X( p) in the closed contour. 


X*(s)-2 X residue of C. at pole of X( » (3-22) 
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Im 


x p plane 


1 Figure 3-8 Closed contour in the left 
peg rue half of the p plane. 


Poles of 


[Refer to Problem A-3-6 for the derivation of Equation (3—22).] By substituting z 
for e™ in Equation (3-22), we have 


X(z) = 5 residue of zd ahs at pole of X( » 


z — e? 
By changing the complex variable notation from p to s, we obtain 
X(s)z 
z= e” 


X(z)=5 [residue of at pole of xe) (3-23) 


Assume that X(s) has poles 51,55, ..., 54. If a pole at s = s; is a simple pole, 
then the corresponding residue K; is 


X 
K; = lim [e - sj) oz] (3-24) 
ss; Z= g 
If a pole at s = s; is a multiple pole of order n;, then the residue K; is 
TE ni „n X(s)z 
Tum (n; — pilin | si) PUE (3-25) 
Example 3-1 
Given 
cd ee 
p s(s + 1) 


obtain X(z) by use of the convolution integral in the left half-plane. 
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Note that X(s) has a double pole at s = 0 and a simple pole at s = —1. Hence, 
Equation (3-23) becomes 


X(z) => residue of 20x at pole of X e 


Bre : sim dle E Dz E =| dm le SD s Dz 5] 
aie —-z[z - e? + (s + D)(- T)e?] PNE z 
$0 (s + 1Y(z — e^y (-1yz-e* 
creer Ter) PERS ME z(T-1-*e7?^)*z(1-e- Te’) 
(z - 17 z-e? (z — 1)°(z - e`") 


_(T-1te "jz +(1-e"- Tez? 
B (1-z"yY(1—- ez) 

Evaluation of the Convolution Integral in the Right Half-Plane. Let us next 
evaluate the convolution integral given by Equation (3-21) in the right half of the 
p plane. Let us choose the closed contour shown in Figure 3-9, which consists of the 
line from c — jo to c + jo and I, the portion of the semicircle of infinite radius 
in the right half of the p plane that lies to the right of this line. The closed contour 
encloses all poles of I/[1 — e 7167], but it does not enclose any poles of X( p). Now 
X* (s) can be written as 


WY 


Poles of ——————— 
oles 1-e7?5-2 


Figure 3-9 Closed contour in the right half of the p plane. 
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1 (v* X(p) 
X*(s) = Inj cope 1- e T = dp 
X(p) d. X(p) 
= mir ete P 7 35]. o een P (3-26) 


In evaluating the integrals on the right-hand side of Equation (3-26), we need 
to consider two cases separately: one case where the denominator of X(s) is two or 
more degrees higher in s than the numerator, and another case where the denom- 
inator of X(s) is only one degree higher in s than the numerator. 

Case 1: X(s) has a denominator two or more degrees higher in s than the 
numerator. For this case, since X(s) possesses at least two more poles than zeros, 
we have 


limsX(s) = x(0+) = 0 


Then the integral along Iz is zero. Thus, in the present case 


X(p) - 
xil. 1- e I8- T— 6 dP =0 
and X*(s) can be obtained as follows: 
X*(s) == Y X( + jo.) (3-27) 
k=-% 


[For the derivation of Equation (3-27), see Problem A-3-7.] Thus 


X(z) = i x6 + jo,k) (3-28) 


s=(1/T) Inz 
Note that this expression of the z transform is useful in proving the sampling theorem 
(see Section 3-4). However, it is very tedious to obtain z transform expressions of 
commonly encountered functions by this method. 

Case 2: X(s) has a denominator one degree higher in s than the numerator. For 
this case, lim sX (s) = x(0+) # 0 < œ and the integral along Iz is not zero. [The 
nonzero value is associated with the initial value x(0+) of x(t). ] It can be shown that 
the contribution of the meee along Iz in Equation (3-26) is —}x(0+). That is, 


__ x(p) — 
x5. alo 1- e Ter) 


Then the integral term on the right-hand side of Equation (3-26) becomes 


dp = - 5¥(0+) 


X*(s) = PE + j,k) + 5¥(0+) (3-29) 


Example 3-2 


Show that X* (s) is periodic with period 27/w,. 
Referring to Equation (3-29), 


X*(s) = LX X(s + josh) + +x(0+) 
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Hence, 
x , ES ; 1 
X*(s + jo, k) = T Y X(s + jask + ja,h) + 2*(0*) 
h=-% 
Let k + h = m. Then this last equation becomes 
* j = ls i 1 * 
X*(s + jo k) = z > X(s + jom) + 5x (0+) = X*(s) 
Therefore, we have 
X*(s) = X*(s + jo, Kk), k =0,1,2,... 
Thus, X* (5) is periodic, with period 27/w,. This means that, if a function X(s) has a 


pole at s = s; in the s plane, then X*(s) has poles at s = s, + jw,k (k = 0,1,2,...). 


Obtaining z Transforms of Functions Involving the Term (1 — e ")/s. We shall 
here consider the function X(s) involving (1 — e~™)/s. Suppose the transfer function 
G(s) follows the zero-order hold. Then the product of the transfer function of the 
zero-order hold and G(s) becomes 


1 —e@ 5 
M 


X(s) = G(s) 


In what follows we shall obtain the z transform of such an X(s). 
Note that X(s) can be written as follows: 


xo) = à - e ) SO - a - ens) (3-30) 
where 
Gis) = 99) 
Consider the function 
X) = e^ Gis) (3-31) 


Since X4(s) is a product of two Laplace-transformed functions, the inverse Laplace 
transform of Equation (3-31) can be given by the following convolution integral: 


«(0 = fat - Del) dr 
where 
gt) = £ [e 7] = 8(t — T) 
gi(t) = £^ [Gi)] 
Thus, 
x(t) = [ èt- T - dgl) dr 


= gi(t — T) 
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Hence, by writing 

Z [gi(t)] = Gi) 
the z transform of x,(t) becomes 

Z[u(t)] = Z [gt - T)] = z 6G) 
Referring to Equations (3-30) and (3-31), we have 
X(z) = Z[Gis) - e ^ Gi(s)] 

= Z [n()] - £ baQ)] 

= Gi(z) - z ! Gi(z) 

= (1 - z"')G,(z) 


OT 
X(z) = Z[X()] = (1 - ez [er (3-32) 


We have thus shown that if X(s) involves a factor (1 — e 7*) then, in obtaining the 

z transform of X(s), the term 1 — e^ = 1 — z^' may be factored out so that X(z) 

becomes the product of (1 — z^!) and the z transform of the remaining term. 
Similarly, if the transfer function G(s) follows the first-order hold G,;(s), where 


1—-e^5Y Ts +1 
Gae) = ( " ) E 


then the z transform of the function 


1-e?YTs +1 
£7) Blog 


X(s) -( 


can be obtained as follows. Since 


X(s) = Q- e PEG) 


by employing the same approach as used in obtaining Equation (3-32), we have 


at 


X(z) = z|a -eDyoM GG | 


=(1- ey p tlg | (3-33) 


Equation (3-33) can be used for obtaining the z transform of the function involving 
the first-order hold circuit. 


Example 3-3 


Obtain the z transform of 
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Referring to Equation (3-32), we have 
1-e^ 1 
xe 27 3] 
=(1- zz] 1 | 
s(s + 1) 
1 1 
—(1—.M-|i. 
-ü-cz yzl: s + ; 
- 1 1 
-a- e 5-7) 


1-2z 1—e“‘z 
_d-e%)z! 
| Joe tz 


3-4 RECONSTRUCTING ORIGINAL SIGNALS 
FROM SAMPLED SIGNALS 


Sampling Theorem. If the sampling frequency is sufficiently high compared 
with the highest-frequency component involved in the continuous-time signal, the 
amplitude characteristics of the continuous-time signal may be preserved in the 
envelope of the sampled signal. 

To reconstruct the original signal from a sampled signal, there is a certain 
minimum frequency that the sampling operation must satisfy. Such a minimum 
frequency is specified in the sampling theorem. We shall assume that a continuous- 
time signal x(t) has a frequency spectrum as shown in Figure 3-10. This signal x(t) 
does not contain any frequency components above w, radians per second. 


Sampling Theorem. If w,, defined as 27/T, where T is the sampling period, 
is greater than 2«, or 


w, > 204 


where œ is the highest-frequency component present in the continuous-time sig- 
nal x(t), then the signal x(t) can be reconstructed completely from the sampled 
signal x* (t). 

The theorem implies that if œ, > 2%; then, from the knowledge of the sampled 
signal, it is theoretically possible to reconstruct exactly the original continuous-time 
signal. In what follows, we shall use an intuitive graphical approach to explain the 
sampling theorem. For an analytical approach, see Problem A-3-10. 

To show the validity of this sampling theorem, we need to find the frequency 


| X(jw) | 


-w, 0 w w Figure 3-10 A frequency spectrum. 
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spectrum of the sampled signal x*(t). The Laplace transform of x* (t) has been 
obtained in Section 3-3 and is given by Equation (3-27) or (3-29), depending on 
whether x(0+) = 0 or not. To obtain the frequency spectrum, we substitute jw for 
s in Equation (3-27). [In discussing frequency spectra, we need not be concerned 
with the value of x(0+).] Thus, 


Llc voa; 
X*(jo) =F È Xo + jak) 


=... + Ao — @,)) + +X (jo) + EXU te)t:- (3-34) 


Equation (3-34) gives the frequency spectrum of the sampled signal x* (t). We see 
that the frequency spectrum of the impulse-sampled signal is reproduced an infinite 
number of times and is attenuated by the factor 1/T. Thus, the process of impulse 
modulation of the continuous-time signal produces a series of sidebands. Since X* (s) 
is periodic with period 27/w,, as shown in Example 3-2, or 


X*(s) = X*(s + jo, k), k =0,1,2,... 
if a function X(s) has a pole at s = sı, then X*(s) has poles at s = s, + jo,k 


(k = 0,1,2,...). 
Figures 3~11(a) and (b) show plots of the frequency spectra X*( jw) versus w 


| X* (joo) | 


(a) 


| X* (o | 


(b! 


Figure 3-11 Plots of the frequency spectra | X*(jw)| versus w for two values of sampling 
frequency w: (a) & > 201; (b)o, < 20. 
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for two values of the sampling frequency o. Figure 3-11(a) corresponds to w, > 2a, 
while Figure 3-11(b) corresponds to œ, < 2c. Each plot of |X*(jw)| versus w 
consists of |X( jo)|/T repeated every w, = 27/T rad/sec. In the frequency spectrum 
of |X*(jw)| the component |X( jo)|/T is called the primary component, and the other 
components, |X(j(@ + ,k))|/T, are called complementary components. 

If w, > 2@, no two components of |X*( je)| will overlap, and the sampled 
frequency spectrum will be repeated every w, rad/sec. 

If w < 2%, the original shape of |X(jw)| no longer appears in the plot of 
|X*(jw)| versus w because of the superposition of the spectra. Therefore, we see that 
the continuous-time signal x(t) can be reconstructed from the impulse-sampled 
signal x* (t) by filtering if and only if œ, > 2%. 

It is noted that although the requirement on the minimum sampling frequency 
is specified by the sampling theorem as œ, > 2«;, where w, is the highest-frequency 
component present in the signal, practical considerations on the stability of the 
closed-loop system and other design considerations may make it necessary to sample 
at a frequency much higher than this theoretical minimum. (Frequently, œ, is chosen 
to be 10«, to 20%.) 


Ideal Low-Pass Filter. The amplitude frequency spectrum of the ideal low- 
pass filter G;( jw) is shown in Figure 3-12. The magnitude of the ideal filter is unity 
over the frequency range — 3o, = w = 1«, and is zero outside this frequency range. 

The sampling process introduces an infinite number of complementary compo- 
nents (sideband components) in addition to the primary component. The ideal filter 
will attenuate all such complementary components to zero and will pass only the 
primary component, provided the sampling frequency w, is greater than twice the 
highest-frequency component of the continuous-time signal. Such an ideal filter 
reconstructs the continuous-time signal represented by the samples. Figure 3-13 
shows the frequency spectra of the signals before and after ideal filtering. 

The frequency spectrum at the output of the ideal filter is 1/T times the 
frequency spectrum of the original continuous-time signal x(t). Since the ideal filter 
has constant-magnitude characteristics for the frequency region —}, < w x 1o, 
there is no distortion at any frequency within this frequency range. That is, there 
is no phase shift in the frequency spectrum of the ideal filter, (The phase shift of the 
ideal filter is zero.) 


| Glico) | 


w  Figure3-12 Amplitude frequency 
spectrum of the ideal low-pass filter. 
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| X(joo) | | X*(joo) | 1 Y(jo) | 
1 1 
T 
-w4 0 w, w 
ideal filter 
X(s} 5, Gili) 


Figure 3-13 Frequency spectra of the signals before and after ideal filtering. 


It is noted that if the sampling frequency is less than twice the highest- 
frequency component of the original continuous-time signal, then because of the 
frequency spectrum overlap of the primary component and complementary com- 
ponents, even the ideal filter cannot reconstruct the original continuous-time signal. 
(In practice, the frequency spectrum of the continuous-time signal in a control 
system may extend beyond +} w,, even though the amplitudes at the higher frequen- 
cies are small.) 


Ideal Low-Pass Filter Is Not Physically Realizable. Let us find the impulse 
response function of the ideal filter. It will be shown that for the ideal filter an output 
is required prior to the application of the input to the filter. Thus, it is not physically 
realizable. 

Since the frequency spectrum of the ideal filter is given by 


.,_ fi, —}0,< w Sha, 
Giljo) = [o elsewhere 


the inverse Fourier transform of the frequency spectrum gives 


1 [? P 
gt) = 3-[' Gjo do 


1 o2 
=> e! dw 
2m —w2 


1 


— (2ye,t |... 57 (02)jesr 
= - e S e S ) 
2m jt ( 


Or 


1 sin (@, t/2) 
Bilt) = 7 tl (3-35) 
Equation (3-35) gives the unit-impulse response of the ideal filter. Figure 3-14 
shows a plot of g;(t) versus t. Notice that the response extends from? = —œ% tot = v. 
This implies that there is a response for t < 0 toa unit impulse applied att = 0. (That 
is, the time response begins before an input is applied.) This cannot be true in the 
physical world. Hence, such an ideal filter is physically unrealizable. [In many 
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Figure 3-14 Impulse response g,(t) of ideal filter. 


communications systems, however, it is possible to approximate g;(t) closely by 
adding a phase lag, which means adding a delay to the filter. In feedback control 
systems, increasing phase lag is not desirable from the viewpoint of stability. There- 
fore, we avoid adding a phase lag to approximate the ideal filter.] 

Because the ideal filter is unrealizable and because signals in practical control 
systems generally have higher-frequency components and are not ideally band 
limited, it is not possible, in practice, to exactly reconstruct a continuous-time signal 
from the sampled signal, no matter what sampling frequency is chosen. (In other 
words, practically speaking, it is not possible to reconstruct exactly a continuous- 
time signal in a practical control system once it is sampled.) 


Frequency-Response Characteristics of the Zero-Order Hold. The transfer 
function of a zero-order hold is 


e 5 


Gy(s) = = (3-36) 


To compare the zero-order hold with the ideal filter, we shall obtain the frequency- 
response characteristics of the transfer function of the zero-order hold. By substitut- 
ing jw for s in Equation (3—36), we obtain 

2. 1-eP 

Grol jw) m jo 
2e ("Tj eTo _ e (2) Tia) 
i 2jo 
sin (oT72) 
oT/2 


e -(V2)Tje 


=T 


The amplitude of the frequency spectrum of Gyo( jw) is 
sin (wT/2) 
wT/2 


The magnitude becomes zero at the frequency equal to the sampling frequency and 
at integral multiples of the sampling frequency. 


IGio( jo)| = T (3-37) 
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Figure 3-15(a) shows the frequency-response characteristics of the zero-order 
hold. As can be seen from Figure 3-15, there are undesirable gain peaks at frequen- 
cies of 3«,/2, 5w,/2, and so on. Notice that the magnitude is more than 3 dB down 
(0.637 = —3.92 dB) at frequency },. Because the magnitude decreases gradually 
as the frequency increases, the complementary components gradually attenuate to 
zero. Since the magnitude characteristics of the zero-order hold are not constant, 
if a system is connected to the sampler and zero-order hold, distortion of the 
frequency spectra occurs in the system. 

The phase-shift characteristics of the zero-order hold can be obtained as 
follows. Note that sin (w7/2) alternates positive and negative values as w increases 
from 0 to œ, œ, to 2w,, 2w, to 3w, and so on. Thus, the phase curve [Figure 3-15(a), 
bottom] is discontinuous at o = kw, = 2zk/T, wherek = 1,2,3,.... Sucha discon- 
tinuity or a switch from a positive value to a negative value, or vice versa, may be 
considered to be a phase shift of +180°. In Figure 3-15(a), phase shift is assumed 
to be —180°. (It could be assumed to be +180° as well.) Thus, 


/Gu(jo) = [Then CTD) yg mier 
w 


= 2 -(V2yeT — z 
= sin 2 / e an 2 2 


0.637T 


W, 20, 3o, 


t Gro 
-540° [9407 
-720° -720 
-900° 90005 1 5 10 20 
w (rad/sec} 
"AT 
(a) (b) 


Figure 3-15 (a) Frequency-response curves for the zero-order hold; (b) equivalent Bode 
diagram when T = 1 sec. 
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where 
oT 


/g UiT = — 


Sin = 0° or +180° 


A modification of the presentation of the frequency-response diagram of 
Figure 3-15(a) is shown in Figure 3-15(b). The diagram shown in Figure 3-15(b) 
is the Bode diagram of the zero-order hold. The sampling period T is assumed 
to be 1 sec, or T = 1. Notice that the magnitude curve approaches —~ decibels at 
frequency points that are integral multiples of the sampling frequency w, = 
2m/T = 6.28 rad/sec. Discontinuities of the phase curve [Figure 3-15(b), bottom] 
occur at these frequency points. 

To summarize what we have stated, the frequency spectrum of the output of 
the zero-order hold includes complementary components, since the magnitude 
characteristics show that the magnitude of Gjo( jw) is not zero for |w| > 1c, except 
at points where w = +œ, w = +2,,w = +3,,.... In the phase curve there are 
phase discontinuities of +180° at frequency points that are multiples of @,. Except 
for these phase discontinuities, the phase characteristic is linear in w. 

Figure 3-16 shows the comparison of the ideal filter and the zero-order hold. 
For the sake of comparison, the magnitudes |G(jw)| are normalized. We see that the 
zero-order hold is a low-pass filter, although its function is not quite good. Often, 
additional low-pass filtering of the signal before sampling is necessary to effectively 
remove frequency components higher than 1o. 

The accuracy of the zero-order hold as an extrapolator depends on the sam- 
pling frequency w,. That is, the output of the hold may be made as close to the 
original continuous-time signal as possible by letting the sampling period T become 
as small as practically possible. 


Folding. The phenomenon of the overlap in the frequency spectra is known 
as folding. Figure 3-17 shows the regions where folding error occurs. The frequency 
1o, is called the folding frequency or Nyquist frequency wy. That is, 


| G(jw) | 


Ideal filter 


Zero-order hold 


p CON j 
[A —2w, TW, 


2 


Figure 3-16 Comparison of the ideal filter and the zero-order hold. 
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| X* (jo) | 


Folding 
error 


s o, 0 9, e, w Figure 3-17 Diagram showing the 
2 2 regions where folding error occurs. 


ON = = T 

In practice, signals in control systems have high-frequency components, and some 
folding effect will almost always exist. For example, in an electromechanical system 
some signal may be contaminated by noises. The frequency spectrum of the signal, 
therefore, may include low-frequency components as well as high-frequency noise 
components (that is, noises at 60 or 400 Hz). Since sampling at frequencies higher 
than 400 Hz is not practical, the high frequency will be folded in and will appear as 
a low frequency. Remember that all signals with frequencies higher than j w, appear 
as signals of frequencies between 0 and 3 o. In fact, in certain cases, a signal of zero 
frequency may appear in the output. 


Aliasing. In the frequency spectra of an impulse-sampled signal x* (t), where 
€ < 2, as shown in Figure 3-18, consider an arbitrary frequency point c, that falls 
in the region of the overlap of the frequency spectra. The frequency spectrum at 
w = w comprises two components, |X* ( j«;)| and |X* (j(e; — @2))|. The latter com- 
ponent comes from the frequency spectrum centered at w = w,. Thus, the frequency 


| X*Uo | 


1 X* Ulo, 7 0211 


-2w, =w, TW 0 


Figure 3-18 Frequency spectra of an impulse-sampled signal x* (t). 
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spectrum of the sampled signal at w = w, includes components not only at frequency 
€» but also at frequency w, — œ (in general, at nw, + œ, where n is an integer). 
When the composite spectrum is filtered by a low-pass filter, such as a zero-order 
hold, some higher harmonics will still be present in the output. The frequency 
component at w = nw, + œ (where n is an integer) will appear in the output as if 
it were a frequency component at w = a». It is not possible to distinguish the 
frequency spectrum at w = œ from that at w = nw, + a. 

As shown in Figure 3-18, the phenomenon that the frequency component 
€, — a (in general, nw, + œ, where n is an integer) shows up at frequency œ when 
the signal x(t) is sampled is called aliasing. This frequency w, — œ (in general, 
nw, + o») is called an alias of w. 

It is important to remember that the sampled signals are the same if the two 
frequencies differ by an integral multiple of the sampling frequency w,. If a signal 
is sampled at a slow frequency such that the sampling theorem is not satisfied, then 
high frequencies are “folded in" and appear as low frequencies. 

To avoid aliasing, we must either choose the sampling frequency high enough 
(e > 2c, where œ is the highest-frequency component present in the signal) or use 
a prefilter ahead of the sampler to reshape the frequency spectrum of the signal (so 
that the frequency spectrum for w > 3c, is negligible) before the signal is sampled. 


Hidden Oscillation. Itis noted that, if the continuous-time signal x(t) involves 
a frequency component equal to n times the sampling frequency w, (where n is an 
integer), then that component may not appear in the sampled signal. For example, 
if the signal 


x(t) = x(t) + x(t) = sint + sin3t 


where x,(t) = sint and x,(t) = sin3t, is sampled at t = 0,27/3, 477/3,... (the sam- 
pling frequency o, is 3 rad/sec), then the sampled signal will not show the frequency 
component with w = 3 rad/sec, the frequency equal to w,. (See Figure 3-19.) 

Even though the signal x(t) involves an oscillation with w = 3 rad/sec [that 
is, the component x(t) = sin 3t], the sampled signal does not show this oscillation. 
Such an oscillation existing in x(t) between the sampling periods is called a hidden 
oscillation. 


3-5 THE PULSE TRANSFER FUNCTION 


The transfer function for the continuous-time system relates the Laplace transform 
of the continuous-time output to that of the continuous-time input, while the pulse 
transfer function relates the z transform of the output at the sampling instants to that 
of the sampled input. 

Before we discuss the pulse transfer function, it is appropriate to discuss 
convolution summation. 


Convolution Summation. Consider the response of a continuous-time system 
driven by an impulse-sampled signal (a train of impulses) as shown in Figure 3-20. 
Suppose that x(t) = 0 fort < 0. The impulse-sampled signal x* (7) is the input to the 
continuous-time system whose transfer function is G(s). The output of the system 
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x, (t) 


sin t 


xa (t) 


x(t) sin t + sin 3t 


x(k) 


Figure 3-19 Plots of x,(£) = sin t, x(t) = sin 3t, and x(¢) = sint + sin 3¢. Sampled 
signal x(k), where sampling frequency w, = 3 rad/sec, does not show oscillation with 
frequency w = 3 rad/sec. 


is assumed to be a continuous-time signal y(t). If at the output there is another 
sampler, which is synchronized in phase with the input sampler and operates at the 
same sampling period, then the output is a train of impulses. We assume that y(t) = 0 
fort <0. 

The z transform of y(t) is 


Z[y@)] = YG) = Zn (3-38) 


5, 


Figure 3-20 Continuous-time system G(s) driven by an impulse-sampled signal. 
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In the absence of the output sampler, if we consider a fictitious sampler (which is 
synchronized in phase with the input sampler and operates at the same sampling 
period) at the output and observe the sequence of values taken by y(t) only at instants 
t = kT, then the z transform of the output y* (t) can also be given by Equation (3-38). 

For the continuous-time system, it is a well-known fact that the output y(t) of 
the system is related to the input x(t) by the convolution integral, or 


y(t) = [se ~ t)x(1) dt = [se — t)g(r) dr 


where g(t) is the weighting function of the system or the impulse-response function 
of the system. For discrete-time systems we have a convolution summation, which 
is similar to the convolution integral. Since 
x*(t) = È x(t)8(t — kT) = È x(kT)à(t — kT) 
k=0 k=0 
is a train of impulses, the response y(t) of the system to the input x* (t) is the sum 
of the individual impulse responses. Hence, 


g(t)x(0), O<t<T 
g(t)x(0) + g(t — T)x(T), T<t<2T 
y(t) = 1g(0x(0) + g(t — T)x(T) + g(t - 2T)x(2T), 2T<t<3T 


g(t)x(0) + gt — T)x(T) + +++ + g(t - kT)x(kT), kT St <(k +1)T 


Noting that for a physical system a response cannot precede the input, we have 
g(t) = 0 fort < Oor g(t — kT) = 0 fort < kT. Consequently, the preceding equa- 
tions may be combined into one equation: 


y(t) = g(0x(0) + g(t — T)x(T) + g(t - 2T)x(2T) + +++ + g(t — kT)x(kT) 
k 
= X g(t- hT)x(hT) O5t5kT 


The values of the output y(t) at the sampling instants t = kT (k = 0,1,2,.. .) are 
given by 


i M> 


y(kT) = 2, g(kT — hT)x(hT) (3-39) 


h 


I 
AES 


x(kT — hT)g(hT) (3-40) 


h=0 


where g(kT) is the system's weighting sequence. [The inverse z transform of G(z) 
is called the weighting sequence.] The summation in Equation (3-39) or (3-40) is 
called the convolution summation. Note that the simplified notation 


W(KT) = x(kT) * g(kT) 


is often used for the convolution summation. 
Since we assumed that x(t) = 0 for t < 0, we have x(kT — hT) = Oforh > k. 
Also, since g(kT — hT) = 0 for h > k, we may assume that the values of h in 


2-0 Y» 
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Equations (3-39) and (3-40) can be taken from 0 to v rather than from 0 to k without 
changing the value of the summation. Therefore, Equations (3-39) and (3-40) can 
be rewritten as follows: 


y(kT) = 


MEE 


g(kT — hT)x(hT) (3-41) 


h 


Ms 


= X x(kT — AT)g(hT) (3-42) 


h=0 


It is noted that if G(s) is a ratio of polynomials in s and if the degree of the 
denominator polynomial exceeds the degree of the numerator polynomial only by 
1 the output y(t) is discontinuous, as shown in Figure 3-21(a). When y(t) is discon- 
tinuous, Equations (3—41) and (3-42) yield the values immediately after the sam- 
pling instants, that is, y(0+), y(T+),...,y(kT+). Such values do not portray the 
actual response curve. 

If the degree of the denominator polynomial exceeds that of the numerator 
polynomial by 2 or more, however, the output y(t) is continuous, as shown in Figure 
3-21(b). When y(t) is continuous, Equations (3-41) and (3-42) yield the values at 


y(t) 
0 T 2T 3T 4T 5T t 
(a) 
y(t) 
Figure 3-21 (a) Plot of output y(t) 
(impulse response) versus t when the 
degree of the denominator polynomial 
of G(s) is higher by 1 than that of the 
numerator polynomial; (b) plot of 
0 T 2T 3T AT 5T t 


output y(t) versus t when the degree of 
the denominator polynomial of G(s) is 
higher by 2 or more than that of the 
(b) numerator polynomial. 
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the sampling instants. The values y(k) in such a case portray the actual response 
curve. 

In analyzing discrete-time control systems it is important to remember that the 
system response to the impulse-sampled signal may not portray the correct time- 
response behavior of the actual system unless the transfer function G(s) of the 
continuous-time part of the system has at least two more poles than zeros, so that 
lim sG(s) = 0. 
pen 


Pulse Transfer Function. From Equation (3-41) we have 
y(kT) = Eg(kT -AT)x(AT), | k-20,12,... 
h-0 
where g(kT — hT) = 0 for h > k. Hence, the z transform of y(kT) becomes 


Y(z) = 2 y(kT)z* 


I 
Msi 


EXT. — AT)x(hT)2~* 


y 
Mel 
UL IMs 


2 8 (mT)æ(hT)z mh 


3 
t 


oo 


gl Ty 2 x(hT)z^" 


TU 


il 
Q3 


(z)X(z) (3-43) 
where m — k — h and 


G(z) = È, g(mT)z^" = z transform of g(t) 
m=0 


Equation (3-43) relates the pulsed output Y(z) of the system to the pulse input 
X(z). It provides a means for determining the z transform of the output sequence 
for any input sequence. Dividing both sides of Equation (3-43) by X(z) gives 


Y(z) 
X(z) 


G(z) given by Equation (3—44), the ratio of the output Y(z) and the input X(z), is 
called the pulse transfer function of the discrete-time system. It is the z transform 
of the weighting sequence. Figure 3-22 shows a block diagram for a pulse transfer 
function G(z), together with the input X(z) and the output Y(z). As seen in 
Equation (3—43), the z transform of the output signal can be obtained as the product 
of the system's pulse transfer function and the z transform of the input signal. 


Xiz) Y(z) i 
Giz) Figure 3-22 Block diagram for a 
pulse-transfer-function system. 


G(z) = (3-44) 
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Note that G(z) is also the z transform of the system's response to the Kro- 
necker delta input: 


1 fork =0 
ALKE JE PART) = fn for k #0 


Since the z transform of the Kronecker delta input is 
X(z) = È x(kT)z* = 
k=0 
then, referring to Equation (3-44), the response Y(z) to the Kronecker delta 
input is 


Y(z) = G(z) 


Thus, the system's response to the Kronecker delta input is G(z), the z transform 
of the weighting sequence. This fact is parallel to the fact that G(s) is the Laplace 
transform of the system's weighting function, which is the system's response to the 
unit-impulse function. 


Starred Laplace Transform of the Signal Involving Both Ordinary and Starred 
Laplace Transforms. In analyzing discrete-time control systems, we often find that 
some signals in the system are starred (meaning that signals are impulse sampled) 
and others are not. To obtain pulse transfer functions and to analyze discrete-time 
control systems, therefore, we must be able to obtain the transforms of output signals 
of systems that contain sampling operations in various places in the loops. 

Suppose the impulse sampler is followed by a linear continuous-time element 
whose transfer function is G(s), as shown in Figure 3-23. In the following analysis 
we assume that all initial conditions are zero in the system. Then the output Y(s) is 


Y(s) = G(s)X*(s) (3-45) 


Notice that Y (s) is a product of X* (s), which is periodic with period 277/w,, and G(s), 
which is not periodic. The fact that the impulse-sampled signals are periodic can be 
seen from the fact that 


X*(s) = X*(s + jak),  k =0,1,2,... (3-46) 


(See Example 3-2.) 
In the following we shall show that in taking the starred Laplace transform of 
Equation (3—45) we may factor out X*(s) so that 


Y*(s) = [G(s)X*(s)]* = [GG)]*X*(s) = G*(s)X* (s) (3-47) 


This fact is very important in deriving the pulse transfer function and also in 
simplifying the block diagram of the discrete-time control system. 

To derive Equation (3-47), note that the inverse Laplace transform of Y(s) 
given by Equation (3—45) can be written as follows: 


xt) ^L xn m yin) 
Gis} 


X x* Y 
= ôr (s) (s) Figure 3-23 Impulse-sampled system. 
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y(t) = £"[G(s)X* (s)] 
= Í g(t - t)x*(t)drT 
0 


= fsa x 1) Xx()86 — kT)dr 


Then the z transform of y(t) becomes 


Y(z) =Z[y@] = € | Secor - ZI 


n=0 


= » Y en T)x(kT)z-*m 


m-0k-0 y 


where m = n — k. Thus, ; 
Y(z) = © g(mT)z^" © x(kT)z-* 
m=0 k=0 


= G(z)X(z) (3-48) 


Since the z transform can be understood as the starred Laplace transform with e^ 
replaced by z, the z transform may be considered to be a shorthand notation for the 
starred Laplace transform. Thus, Equation (3-48) may be expressed as 


Y*(s) = G*(s)X*(s) 


which is Equation (3—47). We have thus shown that by taking the starred Laplace 
transform of both sides of Equation (3—45) we obtain Equation (3—47). 
To summarize what we have obtained, note that Equations (3-45) and (3-47) : 
state that in taking the starred Laplace transform of a product of transforms, where 
some are ordinary Laplace transforms and others are starred Laplace transforms, 
the functions already in starred transforms can be factored out of the starred Laplace 
transform operation. 
It is noted that systems become periodic under starred Laplace transform 
operations. Such periodic systems are generally more complicated to analyze than 
the original nonperiodic ones, but the former may be analyzed without difficulty if 
carried out in the z plane (that is, by use of the pulse-transfer-function approach). 


General Procedures for Obtaining Pulse Transfer Functions. Here we shall 

present general procedures for obtaining the pulse transfer function of a system that 

has an impulse sampler at the input to the system, as shown in Figure 3-24(a). i 
The pulse transfer function G(z) of the system shown in Figure 3-24(a) is 


Y(z) 
X(z) 


= GG) = Z[G(s)] 
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x(t) PA 


ôr 


——— 
ôr Y(z) 


Fictitious 
sampler 


(a) 


x(t) Gis) y(t) 
Xis) Y(s) 


(b) 


Figure3-24 (a) Continuous-time system with an impulse sampler at the input; (b) 
continuous-time system. 


Next, consider the system shown in Figure 3—24(b). The transfer function G(s) is 
given by 
Y(s) 
X(s) 
The important fact to remember is that the pulse transfer function for this system 
is not Z [G(s)], because of the absence of the input sampler. 
The presence or absence of the input sampler is crucial in determining the 


pulse transfer function of a system, because, for example, for the system shown in 
Figure 3-24(a), the Laplace transform of the output y(t) is 


Y(s) = G(s)X* (s) 
Hence, by taking the starred Laplace transform of Y(s), we have 
Y*(s) = G*(s)X*(s) 
or, in terms of the z transform, 
Y(z) = G(z)X(z) 


while, for the system shown in Figure 3-24(b), the Laplace transform of the output 
y(t) is 


= G(s) 


Y(s) = G(s)X(s) 
which yields 
Y*(s) = [G(s)X(s)]* = [GX(s)]* 
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or, in terms of the z transform, 
Y(z) = Z[Y(s)] = Z[G(s)X(s)] = Z[GX(s)] = GX(z) + G(z)X(z) 


The fact that the z transform of G(s)X(s) is not equal to G(z)X(z) will be discussed 
in detail later in this section. 

In discussing the pulse transfer function, we assume that there is a sampler at 
the input of the element in consideration. The presence or absence of a sampler at 
the output of the element (or the system) does not affect the pulse transfer function, 
because, if the sampler is not physically present at the output side of the system, it 
is always possible to assume that a fictitious sampler is present at the output. This 
means that, although the output signal is continuous, we can consider the values of 
the output only at £ = kT (k = 0,1,2,...) and thus get sequence y(kT). 

Note that only for the case where the input to the system G(s) is an impulse- 
sampled signal is the pulse transfer function given by 


GG) = Z[G)] 


Examples 3-4 and 3—5 demonstrate the methods for obtaining the pulse 
transfer function. 


Example 3-4 


Obtain the pulse transfer function G(z) of the system shown in Figure 3-24(a), where 
G(s) is given by 


G(s) = 


Sta 


Note that there is a sampler at the input of G(s) and therefore the pulse transfer function 
is G(z) = Z[G(s)]. 


Method 1. By referring to Table 2-1, we have 


Hence, 


1 
CO) = plv 


Method 2. The impulse response function for the system is obtained as follows: 
g(t) = £'[G()] - e* 
Hence, 
g(kT) = e “7, k =0,1,2,... 


Therefore, 


G(z) = X ger): = > e" Tz -k _ -È (ez) k 
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Example 3-5 
Obtain the pulse transfer function of the system shown in Figure 3—24(a), where G(s) 
is given by 
1-e^ 1 
2 s s(s*1) 


Note that there is a sampler at the input of G(s). 


Method 1. G(s) involves the term (1 — e ^75); therefore, referring to Equation (3-32), 
we obtain the pulse transfer function as follows: 


G(z) = Z[GG)] = zla a exis 
-1c 1 
=(1-z zla + 5l 


1 1 1 
2(fb-2znze|Lh-i 
Send zli s Hl 


From Table 2-1, the z transform of each of the partial-fraction-expansion terms can be 


found. Thus, 
f c m Tz. | 1 
G(2-0-z [a =z yf 1-zg! + l-e tr 
T-1*e?7!'--(1-e7- Te "yz? 
E lte') (l-e Te *)z (3-49) 


(1—-z7)1-e7z!) 
Method 2. The given transfer function G(s) can be written as follows: 
2a-2m[À.i 1 
SO (à res | 


Therefore, by taking the inverse Laplace transform, we have the following impulse 
response function: 


gí)-2(-1-e»()n-[r-T-1-4e€Ph(t- T) 


or 
gkT)-(kT-1-*e)-[(kT-T-1-*e *"PM((k — 1)T) 
Je +T- eD, k 21,2,3,... 
E k=0 
Then the pulse transfer function G(z) can be obtained as follows: 


G(z) = > g(kT)z™* 


k=0 


= Ð [eT + T- e FT z-* + ec -1-T 
k=0 


-(-e)XeU;z;*-TErt-ee-i1-T 
k=0 k=0 
1 T " 
foe ieee cubren 
2h Sl ee ut Dee] c Tete 
B (1—279- ez) 


= (1-7) 
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Pulse Transfer Function of Cascaded Elements. Consider the systems shown 
in Figures 3-25(a) and (b). Here we assume that the samplers are synchronized and 
have the same sampling period. We shall show that the pulse transfer function of the 
system shown in Figure 3-25(a) is G(z)H(z), while that shown in Figure 3-25(b) is 
Z[G(s)H(s)] = Z[GH(s)] = GH(z), which is different from G(z)H(z). 

Consider the system shown in Figure 3-25(a). From the diagram we obtain 


U(s) = G(s)X*(s) 
Y(s) = H(s)U*(s) 
Hence, by taking the starred Laplace transform of each of these two equations, we 


get 
U*(s) = G*(s)X*(s) 
Y*(s) = H*(s)U*(s) 
Consequently, 
Y*(s) = H*(s)U*(s) = H*(s)G*(s)X" (s) 
or 


Y*(s) = G*(s)H*(s)X*(s) 
In terms of the z transform notation, 
Y(z) = G(z)H(z)X(z) 


The pulse transfer function between the output y*(t) and input x*(t) is therefore 


given by 
Y(z) 
= G(z)H(z 
z T OOHO) 
x(t) t x*(t) Gls) u(t) u*(t) mE y(t) y*(t) 
à; ôr 5, 
(a) 


x(t) Pa x*(t) y(t) y*(t) 
G(s) His) ———— 
ôr 5; 


(b) 


Figure 3-25 (a) Sampled system with a sampler between cascaded elements G(s) and H(s); 
(b) sampled system with no sampler between cascaded elements G(s) and H(s). 


Sec. 3-5 The Pulse Transfer Function 109 


Next, consider the system shown in Figure 3-25(b). From the diagram we find 
Y(s) = G(s)H(s)X*(s) = GH(s)X* (s) 
where 
GH(s) = G(s)H(s) 
Taking the starred Laplace transform of Y (s), we have 
Y*(s) = [GH(s)]* X* (s) 
In terms of the z transform notation, 
Y(z) = GH(z)X(z) 
and the pulse transfer function between the output y*(t) and input x*(t) is 


Y(z) 
X(z) 


- GH(z) - Z[GH(s)] 


Note that 
G(z)H(z) + GH(z) = Z[GH(s)] 


Hence, the pulse transfer functions of the systems shown in Figures 3-25(a) and (b) 
are different. We will now verify this statement in Example 3-6. 
Example 3-6 


Consider the systems shown in Figures 3-26(a) and (b). Obtain the pulse transfer 
function Y(z)/X(z) for each of these two systems. 


x(t) x*(t) 1 u(t) u*(t) 1 y(t) 
sta ôr 


G(s) His) 


(a) 


x(t) p x*(t) 1 1 y(t) 
ôy sta stb 


G(s) His) 


(b) 


Figure 3-26 (a) Sampled system with a sampler between elements G(s) = 1/(s + a) 
and H(s) = 1/(s + b); (b) sampled system with no sampler between elements G(s) 
and H(s). 
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For the system of Figure 3—26(a), the two transfer functions G(s) and H(s) are 
separated by a sampler. We assume that the two samplers shown are synchronized and 
have the same sampling period. The pulse transfer function for this system is 


Y(z)  Y(z) U(z) 
X(z) U(z)X(z) 


= H(z)G(z) = G(zMI(z) 


Hence, 


Y(z) Em 1 1 undc dct 
X() GAG) - z|; + A; + ; | l-e"zg!1-e*771! 

For the system shown in Figure 3-26(b), the pulse transfer function Y(z)/X(z) 
is obtained as follows: 


YO -zoonoz 1 : | 


s+as+b 


1 1 1 
-z - 23) 


Hence, 


E B 1 (e aT _ e Di 

X(z) eno b- Ja —-eTgWy(ü-e"'Tz^) 

Clearly, we see that the pulse transfer functions of the two systems are different; that 
is, 

G(z)H(z) * GH(z) 


Therefore, we must be careful to observe whether or not there is a sampler between 
cascaded elements. 


Pulse Transfer Function of Closed-Loop Systems. In a closed-loop system the 


existence or nonexistence of an output sampler within the loop makes a difference 
in the behavior of the system. (If there is an output sampler outside the loop, it will 
make no difference in the closed-loop operation.) 


Consider the closed-loop control system shown in Figure 3-27. In this system, 


the actuating error is sampled. From the block diagram, 


E(s) = R(s) — H(s)C(s) 
C(s) = G(s)E* (s) 


-— 
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Hence, 

E(s) = R(s) — H(s)G(s)E" (s) 
Then, by taking the starred Laplace transform, we obtain 


E*(s) = R*(s) — GH*(s)E* (s) 


or 
R*(s) 
* = 
E'S) = TT GH) 
Since 
C*(s) = G*(s)E*(s) 
we obtain 
«(y = ZOR) 
C'G) = Ty GHG) 
In terms of the z transform notation, the output can be given by 
_ CRE) 
Ce) = Ty GHG) 


The inverse z transform of this last equation gives the values of the output at the 
sampling instants. [Note that the actual output c(t) of the system is a continuous-time 
signal. The inverse z transform of C(z) will not give the continuous-time output c(t).] 
The pulse transfer function for the present closed-loop system is 


Cz) . G() 
Rz) 1+ GHG) 


(3-50) 


Table 3-1 shows five typical configurations for closed-loop discrete-time con- 
trol systems. Here, the samplers are synchronized and have the same sampling 
period. For each configuration, the corresponding output C(z) is shown. Notice that 
some discrete-time closed-loop control systems cannot be represented by C(z)/R(z) 
(that is, they do not have pulse transfer functions) because the input signal R(s) 
cannot be separated from the system dynamics. Although the pulse transfer function 
may not exist for certain system configurations, the same techniques discussed in this 
chapter can still be applied for analyzing them. 


Pulse Transfer Function of a Digital Controller. The pulse transfer function 
of a digital controller may be obtained from the required input-output characteristics 
of the digital controller. 

Suppose the input to the digital controller is e(k) and the output is m(k). In 
general, the output m(k) may be given by the following type of difference equation: 


m(k) + a.m(k — 1) + aam(k —2) +--+ t a,m(k — n) 
= boe(k) + bie(k — 1) +++: + b,e(k — n) (3-51) 


112 z-Plane Analysis of Discrete-Time Control Systems Chap. 3 


TABLE 3-1 FIVE TYPICAL CONFIGURATIONS FOR CLOSED-LOOP DISCRETE-TIME 
CONTROL SYSTEMS 


G(z)R(z) 


C(z) = ————_ 
1+ GH(z) 


Giz)AR(z) 


C(z) = ——— 
1+ G(z)H(z) 


G. 
Clz) = 1 (Z)Gy (z)R(z) 


1+ G,(Z)G,H(z) 


G,(z)G, A(z) 


c7 TT 6,6,H(z) 


GR(z) 


Ca = 16 GHE 


rit) 
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The z transform of Equation (3-51) gives 
M(z) + az™M(z) + az?M(z) + +-+ + az” M(z) 
= bo E(z) + biz ! E(z) + +--+ + b z” E(z) 
or 
(1 + ayz + az? + +++ + az ™)M(z) = (ba + biz) + +++ + b z™E(z) 
The pulse transfer function Gp(z) of the digital controller may then be given by 


M(z) _ bo + biz’ +++ +b,z” 


GoZ)= E( l+azit---+a,z" 


(3-52) 


The use of the pulse transfer function Gp(z) in the form of Equation (3-52) enables 
us to analyze digital control systems in the z plane. 


Closed-Loop Pulse Transfer Function of a Digital Control System. Figure 
3-28(a) shows a block diagram of a digital control system. Here, the sampler, 
A/D converter, digital controller, zero-order hold, and D/A converter produce a 
continuous-time (piecewise-constant) control signal u(t) to be fed to the plant. 
Figure 3-28(b) shows the transfer functions of blocks involved in the system. 

The transfer function of the digital controller is shown as G(s). In the actual 


Zero-order cit) 
hold 
D/A 


(a) 


(b) 


Figure 3-28 (a) Block diagram of a digital control system; (b) equivalent block diagram 
showing transfer functions of blocks. 
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system the computer (digital controller) solves a difference equation whose input- 
output relationship is given by the pulse transfer function Gp(z). 

In the present system the output signal c(t) is fed back for comparison with the 
input signal r(t). The error signal e(t) = r(t) — c(t) is sampled, and the analog signal 
is converted to a digital signal through the A/D device. The digital signal e(kT) is 
fed to the digital controller, which operates on the sampled sequence e(kT) in some 
desirable manner to produce the signal m(kT). 

This desirable relationship between the sequences m(kT) and e(KT) is speci- 
fied by the pulse transfer function Gp(z) of the digital controller. [By properly 
selecting the poles and zeros of Gp(z), a number of input-output characteristics can 
be generated.] 

Referring to Figure 3-28(b), let us define 


1- 


£^ G6) = G() 


From Figure 3-28(b), notice that 

C(s) = G(s)G5(s)E*(s) 
or 

C*(s) = G* (s)G5(s)E* (s) 

In terms of the z transform notation, 

C(z) = G(z)Gp(z)E(z) 
Since 

E(z) = R(z) - C(z) 
we have 
C(z) = G»(z)G(z)[R(z) - C(z)] 

and, therefore, 


C(z) . G»(z)G(z) 
R(z) 1+ Go(z)G(z) 


Equation (3-53) gives the closed-loop pulse transfer function of the digital control 
system shown in Figure 3—28(b). The performance of such a closed-loop system can 
be improved by the proper choice of Gp(z), the pulse transfer function of the digital 
controller. We shall later discuss a variety of forms for Gp(z) to be used in obtaining 
optimal performance for various given performance indexes. 

In the following, we shall consider only a simple case, where the pulse transfer 
function Gp(z) is of the PID (proportional plus integral plus derivative) type. 


(3-53) 


Pulse Transfer Function of a Digital PID Controller. The analog PID control 
scheme has been used successfully in many industrial control systems for over half 
a century. The basic principle of the PID control scheme is to act on the variable 
to be manipulated through a proper combination of three control actions: propor- 
tional control action (where the control action is proportional to the actuating error 
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signal, which is the difference between the input and the feedback signal), integral 
control action (where the control action is proportional to the integral of the 
actuating error signal), and derivative control action (where the control action is 
proportional to the derivative of the actuating error signal). 

Where many plants are controlled directly by a single digital computer (as in 
a control scheme in which from several loops to several hundred loops are controlled 
by a single digital controller), the majority of the control loops may be handled by 
PID control schemes. 

The PID control action in analog controllers is given by 


zw] 


m(t) = Klet) + zk e(t)dt + Ty (3-54) 
where e(t) is the input to the controller (the actuating error signal), m(t) is the output 
of the controller (the manipulating signal), K is the proportional gain, T; is the 
integral time (or reset time), and T; is the derivative time (or rate time). 

To obtain the pulse transfer function for the digital PID controller, we may 
discretize Equation (3-54). By approximating the integral term by the trapezoidal 
summation and the derivative term by a two-point difference form, we obtain 


mer) = K{eter) + TEOD , D+ «en, 


2 
((k — 1)T) + e(kT) e(kT) — e((k — 1)T) 
p AET DDED], teen «d - nn) 


or 


m(kT) = klear) «f += Ty 


e((h — 1)T) * e(AT) 
Tik- 1 2 
Ta 

+ 7 le(kT) — e((k — nni (3-55) 
Define 
-f(T,  f(0-0 
Figure 3-29 shows the function f(hT). Then 

y e((h — 2n + e(hT) 


h-l 


e((h — 1)T) + e(hT) 
2 


-E fT) 


Taking the z transform of this last equation, we obtain 


= e((h — 1)T) + e(hT 
z| p20 + OD) z[5 an] -aro - 10) 
1 
TF) 
(For the derivation of this last equation, refer to Problem A-2-4.) Notice that 
l-z! 


FG) = Z[f(hT)] = ~= EG) 
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e(t) 


e(0) + e(T) _ AT) 
2 


eT) + e27) L or) 
2 


0 T 2T 3T t 


Figure 3-29 Diagram depicting function f(AT). 


Hence, 
e((h — 1)T) + «um. 14z| 
z| 2 TE 
Then the z transform of Equation (3—55) gives 
ts lee n redi 
M(z) = x + 2T1- uit z |E 
This last equation may be rewritten as follows: 
-xii-242— E 
M(z)= K ^: o^ m TI- z it rC z Eo 
E -1 
Kp +727 t Koll - 27) Ez) 
where 
KT K; 
Ke= K- 2n ^ K- E = proportional gain 


K, = m integral gain 
Kp = <n = derivative gain 
Notice that the proportional gain Kp for the digital PID controller is smaller than 
the proportional gain K for the analog PID controller by K;,/2. 

The pulse transfer function for the digital PID controller becomes 


Gp(z) = a =Kp+7 AL = + Kp(1- z^) (3-56) 


The pulse transfer function of the digital PID controller given by Equation (3—56) 
is commonly referred to as the positional form of the PID control scheme. 
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The other form commonly used in the digital PID control scheme is referred 
to as the velocity form. To derive the velocity-form PID control equation, we 
consider the backward difference in m(KkT), that is, the difference between m(kT) 
and m((k — 1)T). With some assumptions and manipulations, we obtain 


R(z) -C() _ 
l-z“ 


[For the derivation of Equation (3-57), see Problem A-3-17.] Equation (3-57) gives 
the velocity-form PID control scheme. Figure 3-30 shows the block diagram realiza- 
tion of the velocity-form digital PID control scheme. Notice that in Equation (3-57) 
only the integral control term involves the input R(z). Hence, the integral term 
cannot be excluded from the digital controller if the velocity form is used. 

An advantage of the velocity-form PID control scheme is that initialization is 
not necessary when the operation is switched from manual to automatic. Thus, if 
there are sudden large changes in the set point or at the start of the process operation, 
the velocity-form PID control scheme exhibits better response characteristics than 
the positional-form PID control scheme. Another advantage of the velocity-form 
PID control scheme is that it is useful in suppressing excessive corrections in process 
control systems. 

Linear control laws in the form of PID control actions, in both positional form 
and velocity form, are basic in digital controls because they frequently give satisfac- 
tory solutions to many practical control problems, in particular, process control 
problems. Note that, in digital controllers, control laws can be implemented by 
software, and therefore the hardware restrictions of analog PID controllers can be 
completely ignored. (For a comparison of the frequency-response characteristics of 
analog and digital PID controllers, see Problem A-3-16.) 


M(z) = —KpC(z) + K; Kp(1— z)C(z) (8-57) 


Example 3-7 


Consider the control system with a digital PID controller shown in Figure 3-31(a). (The 
PID controller here is in the positional form.) The transfer function of the plant is 
assumed to be 


Figure 3-30 Block diagram realization of the velocity-form digital PID control scheme. 
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Zero-order 
hold 


G, (s) 


(a) 


0.367977! + 0.2642z-? 
(1 — 0.367977!)(1 — z^!) 


(b) 


Figure 3-31 (a) Block diagram of a control system; (b) equivalent block diagram. 


1 
G,(s) = TEET 


and the sampling period T is assumed to be 1 sec. Then the transfer function of the 
zero-order hold becomes 


—s 


l-e 
s 


G,(s) = 


Since 


di eae e -2 
z|! En. ]-«o- 0.367927" + 0.2642z TEN 


s s(sc1) (1 — 0.36792 )(1— z7') 
we may redraw the block diagram of Figure 3-31(a) as shown in Figure 3-31(b). 
Let us obtain the unit-step response of this system when the digital controller is 
a PID controller with Kp = 1, K; = 0.2, and Kp = 0.2. The pulse transfer function of 
the digital controller is given by 


1.4 — 1.427! + 0.2z7? 
Coe) age T 
Then the closed-loop pulse transfer function becomes 
Cz) ___ Go(z)G(z) 
R(z) 1+ Go(z)G(z) 
2 0.5151z7' — 0.1452z ? — 0.2963z ? + 0.0528z * 
1 — 1.8528z ' + 1.59062 ? — 0.66422? + 0.05282 * 
We shall use the MATLAB approach to obtain the unit-step response. 
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Obtaining Transient Response with MATLAB. Let us assume that we want the 
unit-step response up to k = 40. Then the input r(t) may be written as 
r — ones(1,41) 


A MATLAB program for obtaining the unit-step response for this system is 
shown in MATLAB Program 3-1. The resulting output c(K) versus k is plotted in 
Figure 3-32. 


MATLAB Program 3-1 


Yo ---------- Unit-step response -------- -= 


num ={0 0.5151 -0.1452 -0.2963 0.0528]; 
den ={[1 -1.8528 1.5906 -0.6642 0.0528] 
r = ones(1,41); 

v=f0 40 0 2l 

axis(v); 

k = 0:40; 

€ = filter(num,den,r); 

plot(k,c,'o' k,c,'-') 

grid 

title("Unit-Step Response!) 

xlabel('k') 

ylabel(‘c(k)') 


Unit-Step Response 


c(k) 


Figure 3-32 Unit-step response. 
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The response of this system to a unit-ramp input can be obtained by entering 
MATLAB Program 3-2 into the computer. The resulting plot is shown in Fig- 


ure 3-33. 


Note that this system exhibits no steady-state error in the ramp response. 


MATLAB Program 3-2 


Unit-ramp response -------- E 


num s [0 0.5151 -0.1452 -0.2963 0.0528]; 
den = [1 -1.8528 1.5906 -0.6642 0.0528]; 


ae 46 0 16]; 


| 3 í 2 
[A Habel w) 


c(k) 


Unit-Ramp Response 


QT 9S 
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Comments. PID controllers for such process control systems as temperature 
systems, pressure systems, and liquid-level systems are usually tuned experimen- 
tally. In fact, in the PID control of any industrial plant, where its dynamics are not 
well known or defined, the controller variables (Kp, Kj, and Kp) must be determined 
experimentally. Such determination or tuning may be made using step changes in 
the reference or disturbance signal. A few established procedures are available for 
such a purpose. Basically, tuning (determining the constants Kp, K;, and Kp) is 
accomplished by systematically varying the values until reasonably good response 
characteristics are obtained. 

For digital PID controllers used for process control systems, the sampling 
period must be chosen properly. Many process control systems have fairly large time 
constants. A rule of thumb in the selection of the sampling period (sampling period 
T = 2arlo,, where c, is the sampling frequency) in process control systems is that 
for temperature control systems the sampling period should be 10 to 30 sec, for 
pressure control systems 1 to 5 sec, and for liquid-level control systems 1 to 10 sec. 


Obtaining Response Between Consecutive Sampling Instants. The z transform 
analysis will not give information on the response between two consecutive sampling 
instants. In ordinary cases this is not serious, because if the sampling theorem is 
satisfied, then the output will not vary very much between any two consecutive 
sampling instants. In certain cases, however, we may need to find the response 
between consecutive sampling instants. 

Three methods for providing a response between two consecutive sampling 
instants are commonly available: 


1. Laplace transform method 
2. Modified z transform method 
3. State-space method 


Here we shall briefly discuss the Laplace transform method. The modified z trans- 
form method is presented in Appendix B. (Those readers interested in the modified 
z transform should read Section B-4.) The state-space method will be discussed in 
Section 5-5. 


Laplace Transform Method. Consider, for example, the system shown in 
Figure 3-27. The output C(s) can be given by 


C) = GG)E*G) = OO TF ORE 
Thus, 
c(t) = £7[C)] = loo (3-59) 


Equation (3—59) will give the continuous-time response c(t). Hence, the response 
at any time between two consecutive sampling instants can be calculated by the use 
of Equation (3-59). [See Problem A-3-18 for sample calculations of the right-hand 
side of Equation (3—59).] 
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3-6 REALIZATION OF DIGITAL CONTROLLERS 
AND DIGITAL FILTERS 


In this section we discuss realization methods for pulse transfer functions that 
represent digital controllers and digital filters. Realization of digital controllers and 
digital filters may involve either software or hardware or both. In general, “realiza- 
tion" of a pulse transfer function means determining the physical layout for the 
appropriate combination of arithmetic and storage operations. 

In a software realization we obtain computer programs for the digital computer 
involved. In a hardware realization we build a special-purpose processor using such 
circuitry as digital adders, multipliers, and delay elements (shift registers with a 
sampling period T as a unit time delay). 

In the field of digital signal processing, a digital filter is a computational 
algorithm that converts an input sequence of numbers into an output sequence in 
such a way that the characteristics of the signal are changed in some prescribed 
fashion. That is, a digital filter processes a digital signal by passing desirable fre- 
quency components of the digital input signal and rejecting undesirable ones. In 
general terms, a digital controller is a form of digital filter. 

Note that there are important differences between the digital signal processing 
used in communications and that used in control. In digital control the processing 
of signals must be done in real time. In communications, signal processing need not 
be done in real time, and therefore delays can be tolerated in the processing to 
improve accuracy. 

This section deals with the block diagram realization of digital filters using 
delay elements, adders, and multipliers. Here several different structures of block 
diagram realizations will be discussed. Such block diagram realizations can be used 
as a basis for a software or hardware design. In fact, once the block diagram 
realization is completed, the physical realization in hardware or software is straight- 
forward. Note that in a block diagram realization a pulse transfer function of z^! 
represents a delay of one time unit (see Figure 3-34.) (Note also that in the s plane 
Z^! corresponds to a pure delay e~™.) 

In what follows we shall deal with the digital filters that are used for filtering 
and control purposes. The general form of the pulse transfer function between the 
output Y(z) and input X(z) is given by 


Y(z) | bo + biz t+ baz? +.. Hx baz" 


E X(z) l-taz)taz?ct--ctaz"" 


n=m (3-60) 


where the a;'s and b;'s are real coefficients (some of them may be zero). The pulse 
transfer function is in this form for many digital controllers. For example, the pulse 
transfer function of the PID controller given by Equation (3—56) can be expressed 
in the form of Equation (3-60), as follows: 


x(k) x(k - 1) 


Figure 3-34 Pulse transfer function 
Xiz) z'X(z) 


showing a delay of one time unit. 


e 
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tK + — (Kp + 2Kp)z ! + Kpz^? 
Gp(z) = (Kp Kı Kp) t D)Z DŽ 
= bo + b,z7! + bz? 
ltaz!lctaz? 


where 

a, = -1 

ü; = 0 

bo = Kp + K, + Kp 

b, = —(Kp + 2Kp) 

b; = Kp 

We shall now discuss the direct programming and the standard programming 

of digital filters. In these programmings, coefficients a; and b; (which are real 
quantities) appear as multipliers in the block diagram realization. Those block 


diagram schemes where the coefficients a; and b; appear directly as multipliers are 
called direct structures. 


Direct Programming. Consider the digital filter given by Equation (3-60). 
Notice that the pulse transfer function has n poles and m zeros. Figure 3-35 shows 
a block diagram realization of the filter. The fact that this block diagram represents 
Equation (3-60) can be seen easily, since from the diagram we have 
Y(z) = -az Y(z) - oz?Y(z) - +++ — az "Y(z) + boX(z) 


+ biz X(z) + <+ + baz ™X(z) 
Rearranging this last equation yields Equation (3—60). 


Figure 3-35 Block diagram realization of a filter showing direct programming. 
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The type of realization here is called direct programming . Direct programming 
means that we realize the numerator and denominator of the pulse transfer function 
using separate sets of delay elements. The numerator uses a set of m delay elements 
and the denominator uses a different set of n delay elements. Thus, the total number 
of delay elements used in direct programming is m + n. 

The number of delay elements used in direct programming can be reduced. In 
fact, the number of delay elements can be reduced from n + m to n (where n = m). 
The programming method that uses a minimum possible number of delay elements 
is called standard programming. 

In practice, we try to use the minimum number of delay elements in realizing 
a given pulse transfer function. Therefore, the direct programming that requires 
more than the minimum number of delay elements is more or less of academic value 
rather than of practical value. 


Standard Programming. As previously stated, the number of delay elements 
required in direct programming can be reduced. In fact, the number of delay 
elements used in realizing the pulse transfer function given by Equation (3-60) can 
be reduced from n + m to n (where n = m) by rearranging the block diagram, as 
will be discussed here. 

First, rewrite the pulse transfer function Y(z)/X(z) given by Equation (3—60) 
as follows: 


Y(z) Y(z) H(z) 
X(z) A(z) X(z) 


1 
= -1 -2 PUDE a 
= (bs + biz + bz + + bnz east arte eae 
where 
Y(z) -1 -2 z 
= by + + tee t baz” 3-61 
H(z) bo bız baz m ( 6 ) 
and 
H(z) 1 


X) l*azitar!t- taz" (3-62) 


Then, draw block diagrams for the systems given by Equations (3—61) and (3-62), 
respectively. To draw the block diagrams, we may rewrite Equation (3—61) as 


Y(z) = bo H(z) + hz H(z) + +++ + baz " A(z) (3-63) 
and Equation (3-62) as 
H(z) = X(z) - az H(z) - @z? H(z) — +++ — a.z " H(z) (3-64) 


Then from Equation (3-63) we obtain Figure 3-36(a). Similarly, we get Figure 
3-36(b) from Equation (3-64). The combination of these two block diagrams gives 
the block diagram for the digital filter G(z), as shown in Figure 3-36(c). The block 
diagram realization as presented here is based on the standard programming. Notice 
that we use only n delay elements. The coefficients a,, a2, . . . , a, appear as feedback 
elements, and the coefficients bo, b,, .. . , bm appear as feedforward elements. 


(c) 


Figure 3-36 (a) Block diagram realization of Equation (3-63); (b) block diagram 
realization of Equation (3-64); (c) block diagram realization of the digital filter 
given by Equation (3—60) by standard programming. 125 
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The block diagrams in Figures 3-35 and 3-36(c) are equivalent, but the latter 
uses n delay elements, while the former uses n + m delay elements. Obviously, the 
latter, which uses a smaller number of delay elements, is preferred. 


Comments. Note first that the use of a minimal number of delay elements 
saves memory space in digital controllers. Also, the use of a minimal number of 
summing points is desirable. 

In realizing digital controllers or digital filters, it is important to have a good 
level of accuracy. Basically, three sources of errors affect the accuracy: 


1. The error due to the quantization of the input signal into a finite number of dis- 
crete levels. (In Chapter 1 we discussed this type of error, which may be con- 
sidered an additive source of noise, called quantization noise. The quantization 
noise may be considered white noise; the variance of the noise is o? — Q?/12.) 

2. The error due to the accumulation of round-off errors in the arithmetic oper- 
ations in the digital system. 

3. The error due to quantization of the coefficients a; and b; of the pulse transfer 
function. This error may become large as the order of the pulse transfer 
function is increased. That is, in a higher-order digital filter in direct structure, 
small errors in the coefficients a; and b; cause large errors in the locations of 
the poles and zeros of the filter. 


These three errors arise because of the practical limitations of the number of 
bits that represent various signal samples and coefficients. Note that the third type 
of error listed may be reduced by mathematically decomposing a higher-order pulse 
transfer function into a combination of lower-order pulse transfer functions. In this 
way, the system may be made less sensitive to coefficient inaccuracies. 

For decomposing higher-order pulse transfer functions in order to avoid the 
coefficient sensitivity problem, the following three approaches are commonly used. 


1. Series programming 
2. Parallel programming 
3. Ladder programming 


We shall discuss these three programmings next. 


Series Programming. The first approach used to avoid the sensitivity problem 
is to implement the pulse transfer function G(z) as a series connection of first-order 
and/or second-order pulse transfer functions. If G(z) can be written as a product of 
pulse transfer functions G,(z), G2(z),...,G,(z), or 


G(z) = G1(2)G(2): :: Go G) 
then the digital filter for G(z) may be given as a series connection of the component 
digital filters Gi(z), G;(z), ... , G,(z), as shown in Figure 3-37. 
In most cases the G,(z) (i = 1,2,...,p) are chosen to be either first- or second- 


order functions. If the poles and zeros of G(z) are known, Gi(z), G2(z), ..., G,(z) 
can be obtained by grouping a pair of conjugate complex poles and a pair of 
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x(k} yik} 
Gi (z) G,(z) p-—--—-- G, (2) 
Xiz) Y(z) 


Figure 3-37 Digital filter G(z) decomposed into a series connection of G,(z), 
G,(z),..., G,(z). 


conjugate complex zeros to produce a second-order function or by grouping real 
poles and real zeros to produce either first- or second-order functions. It is, of course, 
possible to group two real zeros with a pair of conjugate complex poles, or vice versa. 
The grouping is, in a sense, arbitrary. It is desirable to group several different ways 
to see which is best with respect to the number of arithmetic operations required, 
the range of coefficients, and so forth. 

To summarize, G(z) may be decomposed as follows: 


G(z) = Gi(z)G,(z)--- G,(z) 


pit ee Poiltezit+ fiz? 
wil + az ipl t az + diz? 


The block diagram for 
Y(z)_l1+bz' 
X(z) 1+az` 


(3-65) 


and that for 
Y(z)_l+ez'!+fz” 
X(z 1+az' + dz”? 


(3-66) 


are shown in Figures 3—38(a) and (b), respectively. The block diagram for the digital 
filter G(z) is a series connection of p component digital filters such as shown in 
Figures 3—38(a) and (b). 

Parallel Programming. The second approach to avoiding the coefficient sen- 


sitivity problem is to expand the pulse transfer function G(z) into partial fractions. 
If G(z) is expanded as a sum of A, G,(z), G(z), - . . , G,(z), or so that 


G(z) = A + Gz) + Gz) +--+ + G,(z) 


where A is simply a constant, then the block diagram for the digital filter G(z) can 

be obtained as a parallel connection of q + 1 digital filters, as shown in Figure 3-39. 
Because of the presence of the constant term A, the first- and second-order 

functions can be chosen in simpler forms. That is, G(z) may be expressed as 


G(z) =A + Gi(z) + Gz) +--+ + G,{z) 


=A+ Ge) + 5 G(z) 
i=j+1 
j b; d €j t fiz 
“At D 1+ az! + iul t cz! + diz^? 
The block diagram for 
Y(z) _ b; 
XG) l-*az (3-67) 
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Yi ltez'tfz? 


Xz) 1+2 dz? 


(b) 


Figure 3-38 (a) Block diagram representation of Equation (3-65); (b) block 
diagram representation of Equation (3-66). 


and that for 
Y(z) _ e; t fiz | 
X(z l1-tcz!-dz? 
are shown in Figures 3-40(a) and (b), respectively. The parallel connection of g + 1 


component digital filters as shown in Figure 3-40 will produce the block diagram 
for the digital filter G(z). 


(3-68) 


Ladder Programming. The third approach to avoiding the coefficient sensitiv- 
ity problem is to implement a ladder structure, that is, to expand the pulse transfer 
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Figure 3-39 Digital filter G(z) 
decomposed as a parallel connection of 
A, G,(z), GX(z),..., Gaz). 


function G(z) into the following continued-fraction form and to program according 
to this equation: 


G(z) = Ao + ———n 
1 
Biz + 
1 
Byz + ————————— (3-69) 
A, L 1 
B,Z + A, 
The programming method based on this scheme is called ladder programming. Let 
us define 
1 
GíB(z) = ——;; 1,2:: 5m 1 
(27 &z« GP) n 
1 
(A) Site a = 
Gi^(z) A GAG)’ 1-12; ,nm-—1 
Gi) = — 
B,z + ek 
n A, 


Then G(z) may be written as 


G(z) = Ao + G(P(z) 
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Yiz) _ 5 
Xiz) 1 +4a,271 


(a) 


Yiz) . e; + fz"! 


Xz) 14gz'td4z7? 


(b) 


Figure 3-40 (a) Block diagram representation of Equation (3-67); (b) block 
diagram representation of Equation (3—68). 


We shall explain this programming method by using a simple example where 
n = 2. That is, 


G(z) = Ao + 
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By the use of the functions Gí^(z), G(?(z), and GfP(z), the transfer function G(z) 
may be written as follows: 


1 
1 
+ —_—_— 
A, + G§$(z) 
A 1 
Biz + Gf^(z) 
= Ao + G(?(z) 
Notice that GíÍ?(z) may be written as 
Y(z) _ 1 
Xí(z) Biz + G(?(z) 


G(z) = Ag + 
Bız 


= Ag 


GP(z) = (3-70) 


Or 
X(z) - GP? (z)Yz) = BizY(z) 


The block diagram for G{”(z) given by Equation (3-70) is shown in Figure 3—41(a). 
Similarly, the block diagram for G} (z), which may be given by 


RE 
A; 


(b) 


Figure 3-41 (a) Block diagram for G!(z) given by Equation (3-70); (b) block 
diagram for G{(z) given by Equation (3-71). 
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Yz) _ 1 


(A) = = ——— m 
GOO) = x)" A GG) 


(3-71) 
or 

X(z) - GEY(z)¥(z) = A ¥(z) 
may be drawn as shown in Figure 3—41(b). Note that 


1 

A(z) = — 

G; (z ) A, 

By combining component digital filters as shown in Figure 3—42(a), it is 
possible to draw the block diagram of the digital filter G(z) as shown in Figure 
3-42(b). [Note that Figures 3-42(a) and (b) correspond to the case where n = 2.] 


Comments. Digital filters based on ladder programming have advantages 
with respect to coefficient sensitivity and accuracy. Realization of the ladder struc- 
ture is achieved by expanding G(z) into continued fractions around the origin. 

It is noted that the continued-fraction expansion given by Equation (3—69) is 
not the only way possible. There are a few different ways to construct the ladder 


O © 


2g 


Q) 
{arn s 


(9 © 


(a) (b) 


Figure 3-42 (a) Component block diagrams for ladder programming of G(z) given by 
Equation (3-69) when n = 2; (b) combination of component block diagrams showing ladder 
programming of G(z). 


0M 
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structure. For example, a digital filter G(z) may be structured as a continued- 
fraction expansion form around the origin in terms of z~}, as follows: 


G(z) = Ay + 1 : 
Biz t 1 
A, + i 
BÉ t 
A,..+— 
B,z + L 
Á 


n 


Also, instead of G(z), its inverse 1/G(z) may be expanded into continued-fraction 
forms in terms of z or z^! in order to carry out the ladder programming. 
Example 3-8 


Obtain the block diagrams for the following pulse-transfer-function system (a digital 
filter) by (1) direct programming, (2) standard programming, and (3) ladder program- 
ming: 
Y(z) _ | 2-06z' 
X(z) GG) = 1+ 0.5277 
1. Direct programming . Since the given pulse transfer function can be written as 


Y(z) = -0.5z ! Y(z) + 2X(z) — 0.627" X(z) 


direct programming yields the block diagram shown in Figure 3—43. Notice that we need 
two delay elements. 


2. Standard programming. We shall first rewrite the pulse transfer function as 


follows: 
Yc) ¥@) H@) 4 _ 9 3,-n___ 2 — 
X(2) HG)XG) (4 097 DF Ose 
where 
Y(z) L1. -1 
H(z) =1-0.3z 
and 


Figure 3-43 Block diagram realization of Y(z)/X(z) = (2 — 0.6z7')(1 + 0.527!) 
(direct programming). 
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Block diagram realizations of these last two equations are shown in Figure 
3—44(a) and (b), respectively. If we combine these two diagrams, we obtain the block 
diagram for the digital filter Y(z)/X(z), as shown in Figure 3-44(c). Notice that the 
number of delay elements required has been reduced to 1 by the standard programming. 


3. Ladder programming . We shall first rewrite the given Y(z)/X(z) in the ladder 
form as follows: 


Y(z) _ | 22-066 © -16 — 1 
Xu €) 5x95 OS c eT 1 
—0.625z + —— 
—3.2 
Thus, Ao = 2 and 
1 
GOÓXz) = [SERE FR = oa 
—0.625z + 733 Bora — 0.3125 


(a) 


(c) 


Figure 3-44 (a) Block diagram realization of Y(zYH(z) = 1 — 0.3z7'; (b) block 
diagram realization of H(z)/X(z) = 2/(1 + 0.5z7'); (c) combination of block dia- 
grams in parts (a) and (b) (standard programming). 
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x(k) 


Figure 3-45 Block diagram realization 
of Y(zyX(z) = (2 — 0.6z )(1-* 0.5z7") 
(ladder programming). 


Hence, we obtain 
Y(z) = 2X(z) + GÜP(z)X(z) 


Referring to Figure 3-41(a) for the block diagram of G{”(z), we obtain the block 
diagram of the digital filter Y(z)/X(z) as shown in Figure 3-45. Notice that we need 
only one delay element. 


Infinite-Impulse Response Filter and Finite-Impulse Response Filter. Digital 
filters may be classified according to the duration of the impulse response. Consider 
a digital filter defined by the following pulse transfer function: 


Y(z .  botbz!t:cctb,z" 


X(z) cs 1+ az! + az? Ted anz ™" (3-72) 


where n = m. In terms of the difference equation, 
y(k) = -aiy(k — 1) - ay(k — 2) — +++ — a y(k — n) 
+ box(k) + bix(k — 1) + +++ + b,x(k — m) 


The impulse response of the digital filter defined by Equation (3-72), where we 
assume not all a;'s are zero, has an infinite number of nonzero samples, although 
their magnitudes may become negligibly small as k increases. This type of digital 
filter is called an infinite-impulse response filter. Such a digital filter is also called a 
recursive filter, because the previous values of the output together with the present 
and past values of the input are used in processing the signal to obtain the current 
output y(k). Because of the recursive nature, errors in previous outputs may accu- 
mulate. A recursive filter may be recognized by the presence of both a; and b; in the 
block diagram realization. 

Next, consider a digital filter where the coefficients a; are all zero, or where 


Ya) 
X(z) 


In terms of the difference equation, 
y(k) = box(k) + bix(k — 1) +--+ + b,x(k — m) 


The impulse response of the digital filter defined by Equation (3-73) is limited to 
a finite number of samples defined over a finite range of time intervals; that is, the 


-bytbzitbz?Ócte + bmz™ (3-73) 
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impulse response sequence is finite. This type of digital filter is called a finite-impulse 
response filter. It is also called a nonrecursive filter or a moving-average filter. 

In a nonrecursive realization, the present value of the output depends only on 
the present and past values of the input. The finite-impulse response filter can be 
recognized by the absence of the a,’s in the block diagram realization. 


Realization of a Finite-Impulse Response Filter. We shall next consider the 
realization of the finite-impulse response filter. 

Let us define the finite-impulse response sequence (weighting sequence) of the 
digital filter as g(kT). If the input x(kT) is applied to this filter, then the output y(kT) 
can be given by 


y(kT) = X g(hT)x(kT - AT) 


= g()x(kT) + g(T)x((k — 1)T) + +++ + g(kT)x(0) (3-74) 
The output y(kT) is a convolution summation of the input signal and the impulse 
response sequence. The right-hand side of Equation (3—74) consists of k + 1 terms. 
Thus, the output y(kT) is given in terms of the past k inputs x(0),x(T),..., 
x((k — 1)T) and the current input x(kT). Notice that as k increases it is physically 
not possible to process all past values of input to produce the current output. We 
need to limit the number of the past values of the input to process. 

Suppose we decide to employ the N immediate past values of the input 
x((k — 1)T),x((k — 2)T),...,x((k — N)T) and the current input x(kT). This is 
equivalent to approximating the right-hand side of Equation (3-74) by the N + 1 
most recent input values including the current one, or 


Y(kT) = g(0x(kT) + g(Dx((k — 1)T) + +++ + g(NT)((k - N)T) — 8-75) 


Since Equation (3-75) is a difference equation, the corresponding digital filter in the 
z plane can be obtained as follows. By taking the z transform of Equation (3-75), 
we have 

Y(z) = g(0)X(z) + g(T)z ! X(z) + +++ + g(NT)z" X(z) (3-76) 


Figure 3—46 shows the block diagram realization of this filter. 


Figure 3-46 Block diagram realization of Equation (3-76). 
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The characteristics of the finite-impulse response filter can be summarized as 
follows: 


1. The finite-impulse response filter is nonrecursive. Thus, because of the lack of 
feedback, the accumulation of errors in past outputs can be avoided in the 
processing of the signal. 


2. Implementation of the finite-impulse response filter does not require feed- 
back, so the direct programming and standard programming are identical. 
Also, implementation may be achieved by high-speed convolution using the 
fast Fourier transform. 

3. The poles of the pulse transfer function of the finite-impulse response filter are 
at the origin, and therefore it is always stable. 

4. If the input signal involves high-frequency components, then the number of 
delay elements needed in the finite-impulse response filter increases and the 
amount of time delay becomes large. (This is a disadvantage of the finite- 
impulse response filter compared with the infinite-impulse response filter.) 


Example 3-9 


The digital filter discussed in Example 3—8 is a recursive filter. Modify this digital filter 
and realize it as a nonrecursive filter. Then obtain the response of this nonrecursive filter 
to a Kronecker delta input. 

By dividing the numerator of the recursive filter G(z) by the denominator, we 
obtain 


2 — 0.6z7' 
1+0.5z7! 


= 2 — 1.627! + 0.8272 — 0.427? + 0.2274 — 0.1275 + 0.05z~* — 0.02527 + --- 


G(z) = 


By arbitrarily truncating this series at z7”, we obtain the desired nonrecursive filter, as 
follows: 


Y(z) -1 -2 -3 -4 -5 
22-1. +0. — 0. +0. — 0.1 
X(z) 2 — 1.6z 0.8z 4z 2z z 

' 0.05775 — 0.025z 7 (3-77) 
Figure 3—47 shows the block diagram for this nonrecursive digital filter. Notice that we 
need a large number of delay elements to obtain a good level of accuracy. 

Noting that the digital filter is the z transform of the impulse response sequence, 
the inverse z transform of the digital filter gives the impulse response sequence. By 
taking the inverse z transform of the nonrecursive filter given by Equation (3-77), we 
obtain 
y(kT) = 2x(kT) — 1.6x((k — 1)T) + 0.8x((k — 2)T) — 0.4x((K — 3)T) 

+ 0.2x((k — 4)T) — 0.1x((k — 5)T) + 0.05x((k — 6)T) — 0.025x((k — 7)T) 
For the Kronecker delta input, where x(0) = 1 and x(kT) = 0 for k + 0, this last 
equation gives 
»(0) =2 
y(T) = -1.6 
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Yiz) 


Figure 3-47 Block diagram for the digital filter given by Equation (3-77) (non- 
recursive form). 


y(2T) = 0.8 
y(3T) = -0.4 
y(4T) = 0.2 
y(5T) = -0.1 
y(6T) = 0.05 
y(7T) = -0.025 


The impulse response sequence for this digital filter is shown in Figure 3-48. 


Figure 3-48 Impulse response 
sequence for the digital filter given by 
Equation (3-77). 


EXAMPLE PROBLEMS AND SOLUTIONS 


Problem A-3-1 


Consider a zero-order hold preceded by a sampler. Figure 3-49 shows the input x(t) 
to the sampler and the output y(t) of the zero-order hold. In the zero-order hold the 
value of the last sample is retained until the next sample is taken. 
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x(t) 
y(t) yi 
x(t} 
Figure 3-49 Input and output curves 
0 T 2T 3T 4T 5T 67 TT t for a zero-order hold. 
Obtain the expression for y(t). Then find Y(s) and obtain the transfer function 
of the zero-order hold. 
Solution From Figure 3-49 we obtain 
y(t) = x(O[1(0 - 1( - 7)] + (DAE - T) - Yt - 27) 

tx(2T)[1(t — 27) — 1(t - 3T)] +- 

The Laplace transform of y(t) is 
1 e 5 e 5 e 75 
Y(s) = E -3 ) + «ay $773 ) 
e 15 e 7^5 
+ sen $773 )4 ee 
1—-e7 -Ts ~2Ts 

= [x(0)  x(D)e ? + x(2T)e tc] 

| 1- e P a 

= —<— x*(5) 
where 

X*(s) = E x(kT)e *^ = 43 x(kT)8(t — «| 
k=0 k=0 
The transfer function of the zero-order hold is thus 
| Y(s) 1-e^ 
Gro = X*(s) | s 
Problem A-3-2 


Consider a first-order hold preceded by a sampler. The input to the sampler is x(t) and 
the output of the first-order hold is y(t). In the first-order hold the output y(t) for 
kT x t < (k + 1)T is the straight line that is the extrapolation of the two preceding 
sampled values, x((k — 1)T) and x(kT), as shown in Figure 3-50. The equation for the 
output y(t) is 


MORE Tek) -x(k-1T]-^x(KkT, kT St<(k+1)T (3-78) 


Obtain the transfer function of the first-order hold, assuming a simple function 
such as an impulse function at t = 0 as the input x(t). 
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Figure 3-50 Input and output curves 
(0) T 27 3T 4T 57 67 t for a first-order hold. 


Solution. For an impulse input of magnitude x(0) such that x*(r) = x(0)8(t), the 
output y (f) given by Equation (3-78) becomes as shown in Figure 3-51. The mathemat- 
ical expression for y(t) is 


y(t) = «opa + tho - E + xot he - T) 


+ Eo + x(0)* ze - 2T) 


Hence, 


Y(s) = «Xt + i; E zo + a à «(£7 4 s) 
= x(0(1 - 2e + e(t + à 


Ts +1 -Ts 
= x) - e 


Figure 3-51 Output curve of the first- 
order hold when the input is a unit- 
impulse function. 
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Since 
X*(s) = L[x*()] = s[x(0)5(0] = x(0) 

the transfer function of the first-order hold is obtained as follows: 

_ Ys) _ Ts +if1-e™) 
Gu) = X*(s) T ( s 
Problem A-3-3 
Consider the function 
1 — eT 


S 


X(s)= 


Show that s = 0 is not a pole of X(s). Show also that 
1-e™ 


Y(s) = = 


has a simple pole at s = 0. 


Solution If a transfer function involves a transcendental term e^ 


replaced by a series valid in the vicinity of the pole in question. 
For the function 


, then it may be 


1 — p. Ts 


X(s) = 


(3-79) 


S 


let us obtain the Laurent series expansion about the pole at the origin. Since, in the 
vicinity of the origin, e^ ^ may be replaced by 
(SY _ (Tsy 

22 33 7 
substitution of Equation (3-80) into Equation (3-79) gives 


xo) «1n - & «C... 


e^-21-Ts-^ (3-80) 


which is the Laurent series expansion of X(s). From this last equation we see that s — 0 
is not a pole of X(s). 
Next, consider Y (s). Since 


1 _ e ^ 


s? 


Y(s) = 


it may be expanded into the Laurent series as 


We see that the pole at the origin (s = 0) is of order 1, or is a simple pole. 


Problem A-3—4 


Show that the Laplace transform of the product of two Laplace transformable functions 
f(t) and g(t) can be given by 
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1 ctjo 
AAO = zi [ ^ FGG - p) dp G-81) 
Solution The Laplace transform of the product of f(t) and g(t) is given by 
HORO = | fete" ae (3-82) 
Note that the inversion integral is 
2d Í PA 
f) = 3814. F(s)e" ds, t>0 


where c is the abscissa of convergence for F(s). Thus, 


AAO = sof, [ Foe dp ene" at 


Because of the uniform convergence of the integrals considered, we may invert the 
order of integration: 


1 HR E —(s-pX 
sts] = zi | Fle) dp | eter 
Noting that 


f ste "à = G(s - p) 


we obtain 
gfe = zi |... FCE - pd (3-83) 
g 2uidius TOP p)dp 
Problem A-3—5 
Show that the Laplace transform of 
x*(t) = > x(08(t — kT) = x(t) È a(t — kT) (3-84) 
k=0 k=0 


can be given by 


X*(s) = sxo 5 Slt — n| 


1 cTjo 


1 
X(p)i — ren dp (3-85) 


Solution Referring to Equation (3-83), rewritten as 


HOLO] =F [^ FGG - p)dp 


= 2rj c—joo 


where 
f(t) =x) and — g(t) = > é(t — kT) 


and noting that 
£[8(t - kT) = e *^ 
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we have 
42 (t — «| 2146740754474. ...- 1 = 
k=0 1-e 
Since 
G(s) = 43 à - «| — aes 
k=0 l-e 
we have 


GG - p) = 1— m5 
Notice that the poles of 1/[1 — e "^ ?] may be obtained by solving the equation 
1- eT?) = 0 
or 
-T(s - p) = +j2rk,  k=0,1,2,... 


so that the poles are 
p =s =j TEk =s = jk, k = 0,1,2,... 


where w, = 27/T. Thus, there are infinitely many simple poles along a line parallel to 
the jw axis. 
The Laplace transform of x" (t) can now be written as 


X*(s) = al x 5 é(t — «| 


1 c jos 1 

cer ee X(p)i—.--54P (3-86) 
where the integration is along the line from c — jo to c + jæ, and this line is parallel 
to the imaginary axis in the p plane and separates the poles of X(p) from those of 
V[1 — e 767?)]. Equation (3-86) is the convolution integral. It is a well-known fact that 
such an integral can be evaluated in terms of residues by forming a closed contour 
consisting of the line from c — jæ to c + jæ and a semicircle of infinite radius in the 
left or right half-plane, provided that the integral along the added semicircle is a 
constant (zero or a nonzero constant). There are two ways to evaluate this integral (one 
using an infinite semicircle in the left half-plane and the other an infinite semicircle in 
the right half-plane); we shall consider these two cases separately in Problems A-3-6 
and A-3-7. 


Problem A-3-6 


Referring to Equation (3-86), rewritten as 
x6) -35[ 7 x0) ee 
2j /c-je 1-—e Te?) 
show that, by performing the integration in the left half-plane, X*(s) may be given by 


X*()2X residue of LER at pole of xo) (3-87) 
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By substituting z for e^ in Equation (3-87), we have 


X(z) => |reitue of 2 of ee y at pole of xw) 


By changing the complex variable notation from p to s, we obtain 


X(z) => |resiaue of of zu 5 at pole of xo) 
= Solim 1 lim T ile — $i scan As 0] 
+ $ lim m 5j) oa 


j=h+1 5—5} 


where we assumed that X(z) has A different multiple poles and m — h simple poles 
(m = h). We assume that the poles of X(s) lie in the left half-plane and that X(s) can 
be expressed as a ratio of polynomials in s, or 


qs) 
p(s) 


where q (s) and p(s) are polynomials in s. We also assume that p(s) is of a higher degree 
in s than q(s), which means that 


X(s) = 7 


lim X(s) = 0 


Solution We shall evaluate the convolution integral given by Equation (3-86) using 
a closed contour in the left half of the p plane as shown in Figure 3-52. Using this closed 
contour, Equation (3—86) may be written as 


1 peus 1 
X*(s)- SM X(p)i —z-re-5 dP 


04 XQ) 1f _ XQ) 
“Bap Tae OP —aQjni-. re? (3-88) 


where the closed contour consists of the line from c — jo to c + jæ and T; , which in 
turn consists of a semicircle of infinite radius and the horizontal lines at j and —jo, 
which connect the line from c — jo to c + jo with the semicircle in the left half of the 
p plane. We choose a value of c such that all the poles of X( p) lie to the left of the line 
from c — jo to c + jæ and all the poles of t/[1 — e "€ ?] lie to the right of this line. 
The closed contour encloses all poles of X(p), while the poles of 1/[1 — e 767?] are 
outside the closed contour. 

Because we have assumed that the denominator of X(s) is of a higher degree in 
s than the numerator, the integral along T, (the infinite semicircle in the left half-plane 
plus the horizontal lines at joo and —j», which connect the line from c — jo to c + jæ 
with the semicircle) vanishes. Hence, 

abe X 
X*(s) = Inj 1E ap 

This integral is equal to the sum of the residues of X(p) in the closed contour. (Refer 
to Appendix B for the residue theorem.) Therefore, 


X*(s) => residue of Du at pole of xo)| (3-89) 


am 
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Im 


p plane 


Poles of 
X(p) 


1 


Poles of —————— — 
i- eT -p 


Figure 3-52 Closed contour in the left half of the p plane. 


By substituting z for e™ in Equation (3-89), we have 


X 
X(z) => residue of E (p B at pole of X( »| 
By changing the complex variable notation from p to s, we obtain 
X 
xy |resiaue of - o at pole of xe (3-90) 
Let us assume that X (s) has poles 51,52, ... ,5,. If a pole ats = s;is a simple pole, 
then the corresponding residue K; is 
X 
K; = lim le - s) ex (3-91) 
sj zZ—€ 
If a pole at s = s; is a multiple pole of order n;, then the residue K; is 
1 . an . X(s)z 
d — T TN. ym 7 ði ram 3- 2 
K (ni m 1) mas le Si) z-— eT ( 9 ) 


Therefore, if X(s) has a multiple pole s; of order n, a multiple pole s? of order nz, . . . , 
a multiple pole s, of order na, and simple poles Sa+1, S7+2, - - - Sm; then X(z) given by 
Equation (3-90) can be written as 


X(z) => residue of AG at pole of X | 
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um a X(5)z 
= 2G _ 11 mas [e = i) z— e^ 
= X 
+ > lim le - n Žo (3-93) 
j=h+1 55; 2—6€ 
where n; is the order of the multiple pole at s = s;. 
Problem A-3—7 
Referring to Equation (3-86), rewritten as 
1 (77  X(p) 
* = — 
X (s) 2nj c-je 1 _ e Te P 
show that by performing this integration in the right half p plane, X* (s) may be given 
by 
12 
X*G) 7 3 È X(s + jk) (3-94) 
k=—0 


provided that the denominator of X(s) is two or more degrees higher in s than the 
numerator. Show that if the denominator of X(s) is only one degree higher in s than 
the numerator then 


X*(s) = 1 > X(s +josk)+ 5¥(0+) (3-95) 

k=—0 
Solution Let us evaluate the convolution integral given by Equation (3-86) in the right 
half of the p plane. Let us choose the closed contour shown in Figure 3-53, which 
consists of the line from c — jotoc + jo and I, the portion of the semicircle of infinite 
radius in the right half of the p plane that lies to the right of this line. The closed contour 
encloses all poles of 1/[1 — e 7677], but it does not enclose any poles of X(p). Now 
X* (s) can be written as 


* 1 (^^ X(p) 
X*(s)- Inj je 1 — o Te P 
1 X(p) d X(p) 


“Inj ie OP Faire TP G2) 

Let us investigate the integral along Ix, the portion of the infinite semicircle to 
the right of the line from c — jo toc + jæ. Since infinitely many poles of 1/[1 — e 76-?] 
lie on a line parallel to the jw axis, the evaluation of the integral along I is not as simple 
as in the previous case, where the closed contour enclosed a finite number of poles of 
X(p) in the left half of the p plane. 

In almost all physical control systems, as s becomes large, X(s) tends to zero at 
least as fast as 1/s. Hence, in what follows, we consider two cases, one where the 
denominator of X (s) is two or more degrees higher in s than the numerator and another 
where the denominator of X(s) is only one degree higher in s than the numerator. 


Case 1: X(s) Possesses at Least Two More Poles Than Zeros. Referring to the theory 
of complex variables, it can be shown that the integral along Tx is zero if the degree 
of the denominator p (s) of X(s) is greater by at least 2 than the degree of the numerator 
q(s); that is, if X(s) possesses at least two more poles than zeros, which implies that 


lim sX(s) = x(0+) = 0 
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—— 
ieee LEE 
1-e75-» 


Poles of 


Figure 3-53 Closed contour in the right half of the p plane. 


then the integral along Tr is zero. Thus, in the present case 


1 X(p) = 
rji e enp 
Therefore, Equation (3-96) simplifies to 
" 1 X(p) 
X*(s) = xj Toe te P (3-97) 


The integral along the closed contour given by Equation (3-97) can be obtained by 
evaluating the residues at the infinite number of poles at p = s + jw,k. Thus, 
: X(p) 
* A = + s = 
X (s) E ES fi» (s Jo k)i — e T(s-p) 
The minus sign in front of the right-hand side of this last equation comes from the fact 


that the contour integration along the path Iz is taken in the clockwise direction. Using 
L'Hópital's rule, we obtain 


My 5 — Xe) 
X (s) mS jum T gem 


dp pHstjwsk 
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Noting that 
d 


—HnH-—ge-T6-P . = —Tpo-TG-P) = — ‘Tosk — mk — 
dp [1-e um" Te P m Te! Te! T 
we have 
v Xo) 
* = — pA? A 
x"(s) P —T pastjask 
or 
X*(s) = 72 X(s + jok) (3-98) 
Thus, 
lx . 
X(z) = Ta Xe + jo, k) secur) mz (3-99) 


Note that this expression of the z transform is useful in proving the sampling theorem 
(see Section 3-4). However, it is very tedious to obtain z transform expressions of 
commonly encountered functions by this method. 


Case 2: X(s) Has a Denominator One Degree Higher in s Than the Numerator. For 
this case lim,..sX(s) = x(0--) # 0 < œ and the integral along Tr is not zero. [The 
nonzero value is associated with the initial value x(0--) of x(t).] It can be shown that 
the contribution of the integral along Ir in Equation (3-96) is —4x(0+). That is, 
x(p) 


1 
Inj rele TOP = 75x(0*) 


d. 
Then the integral term on the right-hand side of Equation (3-96) becomes 


1 3 X(s + josk) + 1 os) (3-100) 
T, 2 


X*(s)- 
Problem A-3-8 
Consider the function 


EN te 0 


«0 - [s t«0 


Obtain X(z) by using the convolution integral in the right half-plane. 


Solution The Laplace transform of x(t) is 


X(s) = 


sta 


Clearly, lim,...sX(s) = x(0+) = 1, or the function has a jump discontinuity at t = 0. 
Hence we must use Equation (3-95). Referring to this equation, we have 
< 1 
l y x(5 + jø,k) + 510^) 
k 


=% 


X*(s) = 


Nie 


= i> [X(s + jo k) + X(s — jo, k)] + xe) + 
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zi 


wie 


1| < 1 
-ix( + jo,k +a Umen 
1 
2 


_1l< 2(s + a) 
i p stay lo ky E 


1| Š 2(s-ayo, Ws 1 
= — -n t I tz — 
27 k-1 ( + 2 2 sta 2 G3 101) 
5 +k 


Referring to a formula available in mathematical tables, 
c 2x 1 1+e?™ 
> 


= + -= ——_— 
ex crk x Ti-e?* 
and noting that 


Sta 
2T 


= T(s + a) 


we can rewrite Equation (3-101) in the form 
(mite 77.1 
X = 2G Te TH t 
1 1 + e Teta) + 1 — e Teta 
rs 
1 2 
2 


1- e Teta) 


or 


1 
XG) = Tar 


Thus, we have obtained X(z) by using the convolution integral in the right half-plane. 
[This process of obtaining the z transform is very tedious because an infinite series of 
X(s + jw, k) is involved. The example here is presented for demonstration purposes 
only. One should use other methods for obtaining the z transform. ] 


Problem A-3-9 
Obtain the z transform of 


S 
(s + 1)°(s +2) 


by using (1) the partial-fraction-expansion method and (2) the residue method. 


X(s) = 


Solution 


1. Partial-fraction-expansion method. Since X (s) can be expanded into the form 
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we have 
B 1 Te7z^ 1 
XG) = A; ead @-etry (en) 
27 2e 72 - Te tz 2 
a — e Tz y 1 — e2Tz7 
2. Residue method. Referring to Equation (3-93) and noting that X(s) has a 
double pole at s = —1 and a simple pole at s = —2, we have 


1 . d 2 s — 
X(z) = Q-11ma lc +1) (s + DXs + 2) z- =| 


. s z 
+ lim [e +2) (s + 1)(s + 2)z - =| 


_227-2zeT-Tze™ — 2z 
(z-e Ty z—-e?r 
2-272! ~ Te Tz ^ — 2 
(l—-e?z l-e7 zz! 


Problem A-3-10 
Consider a continuous-time signal x (t) with frequency spectrum limited to between — «i 
and w. That is, 
X(jo) = 0, for w < —«, and «i < w 


Prove that if this signal is sampled with frequency w, > 2«, then the Fourier transform 
of x(t) is uniquely determined by x(kT), k = ..., —2, —1,0,1,2,..., and the original 
continuous-time signal x(t) can be given by a sum of an infinite series of weighted 
sampled values x(kT) as follows: 

= sin[w,(t — kT)/2] 


x(t) = 2 x(kT) walt — kTy 


(This is Shannon’s sampling theorem.) 


Solution The Fourier transform of x(t) is given by 


oo 


X(jo) = Í e?" x(t) dt 
and the inverse Fourier transform is given by 
= 1 Í ° jwt H 
x(t) = 2 e X(jw) do 


Define the sampled version of x(t) as x*(t). Then x*(t) can be given by 
x*(t) = +++ + x(- T)é(t + T) + x(0)ó(t) + x(T)é(t - T) + 


co 


= M x(kT)é(t — kT) 


kz—w 


The Fourier transform of x* (t) is 


X*(jo) = [ eua = T e| X x(kT)&(t — «| dt 


=% 


eo 


€ x(kT)e 7 


ko 9 


H 
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Thus, X* (jæ) is uniquely determined by x(kT),k = ..., —2,-1,0,1,2,.... 
Referring to Equation (3—27), the Fourier transform of x* (t) can be given by 


vul S xin a; 
X* (jw) = T= X(jo + jo, k) 


Since the frequency spectrum of the original continuous-time signal x(t) is limited to 
between —« and a1, we have 


X(jo) = 0, for w < —e and oi < w 
Since the sampling frequency w, is greater than 2«;, we have 
X(jo) = 0, for w < —1@, and ia, < w 


Hence, 


X*(o) = Xp + XQo + je) + Xo) + XGo — je) +] 


-iXGo) 
Thus, we obtain 
*(j —1 1 
xo) = {7% Go), 29; = 0 S34; 


The inverse Fourier transform of X( jæ) gives 


x(t) = = [ex jo) do 


= zz] eX" Go) do 
1 «2 ) ld . 

=> Í | X x(kT)e 7 | dw 
Ws J —ws/2 k-2—o 


d ans /2 
=} 5 x(eT) | oP do 


Ws ka—w 
1 < gx kn 
= "RN Kt — kT) 
0x sin [w(t — kTy/2] 
= PE GT) (t — KT 
Hence, we have shown that the original continuous-time signal x(t) can be reconstructed 
from the sampled data x (kT). [Note that unless X(jw) = 0 for w < —« and «i < w 


the continuous-time signal x(f) cannot be determined by sampled data x(KT), 
k -...,-2,-1,0,1,2,....] 


Problem A-3-11 


Draw the magnitude and phase curves of the first-order hold. Then compare the 
magnitude and phase characteristics of the first-order hold with those of the zero-order 
hold. 


Solution The transfer function of the first-order hold is 


Ts t i(1- e ^Y 
oo = BE) 


ws /2 


—ws/2 
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By substituting jw for s in G(s), we obtain 
oo Tw * 1(1- en V 
TRURESC E ( jo 
= Tw +1 Lens mem 
T jo 
_ Tjo + E nem 
T jo 
_ Tjo * 1. ;,,4 sin (Tw/2) 
Em A EE E 
Hence, 
i 2 
Guia = TV x [Cre 
Ta/2 
/Gix(jo) = /Tjo + 1 + fe 


= tan ! To — Tw 


Ws Ws 


where we have used the relationship T = 27/a,. 
At a few selected values of w, we have 


IGn(j0)| = T YA Gin(j0) = 0° 


onli) = 1.336T L2 21077 


2 o 
c (2) > c (4) = —279.0 


Figure 3-54 shows plots of the magnitude and phase characteristics of the first-order 
hold and those of the zero-order hold. From Figure 3-54 it is seen that both the 
zero-order hold and the first-order hold are not quite satisfactory low-pass filters. They 
allow significant transmission above the Nyquist frequency, wy = z/T. It is important, 
therefore, that the signal be low-pass-filtered before the sampling operation so that the 
frequency components above the Nyquist frequency are negligible. 


Problem A-3-12 
Consider the zero-order hold shown in Figure 3-55. From the diagram we have 
l-e? 


¥(s) = G(s)X*(s) = — 


X*(s) (3-102) 
Show that 
Y*(s) = X*(s) 


Solution By taking the starred Laplace transform of Equation (3-102), we have 


Y*(s) e ( ox =) eo 
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T 
$ 
o 
E 
t 
Ed 
2 rT 
2 
0 7 2n 3r 4n w 
T T T T 
us 2v 3r an 
T T T T w 
0° 
—90? 
—180? 
$ -270° 
E 
eo 
3 —360? 1 Gn (iw) 
n. 


Figure 3-54 Magnitude and phase characteristics of the first-order hold and those 
of the zero-order hold. 


In terms of the z transform notation, we have 
1 E e 
Y(z) =Z m X(z) 


where 


| us ZH Peu ed 


G(s) Figure 3-55  Zero-order hold. 
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Hence, 
Y(z) = X(z) 
In terms of the starred Laplace transform notation, this last equation can be written as 
Y*(s) = X*(s) 
Problem A-3-13 
Obtain the weighting sequence of the system defined by 


1 
GG) * Gary 
for n — 1, 2, and 3, respectively. 
Solution For n = 1, we have 


1 


OT Tani 


=1-—az'+@z?-a@z4+.--- 


Hence, the weighting sequence g,(k) is found to be 
&(k) = (-a)* 
For n — 2, we obtain 
1 l-az t dz?-dz?^c-. 
eue (1*az gy ltaz^! 
= 1 ~ 2az7' + 3a7z7? — 4a? z+... 
Hence, the weighting sequence g;(K) is 
Bak) = (k + D)(-a)* 

For n = 3, we get 


G(z) = 1 .1-2az' + 30°27 — 4a? z+ ee 
aM (1 az y 1+ az" 


= 1-3az' + 6a?z™? — 10a?z °? +... 
Hence, the weighting sequence g3(k) is 


g3(k) = QD Day 
Problem A-3-14 


Obtain the discrete-time output C(z) of the closed-loop control system shown in F igure 
3-56. Also, obtain the continuous-time output C(s). 


M 
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Solution From the diagram we have 
C(s) = G2(s)M* (s) 
M(s) = Gi(s)E(s) 
E(s) = R(s) — H(s)C(s) 
Hence, 
M(s) = Gi(s)[R(s) — H(s)C(s)] 
= Gi(s)R(s) — Gi(s)H(s)G2(s)M*(s) 
Taking the starred Laplace transform of this last equation, we obtain 
M*(s) = [Gi R(s)]* — [Gi G2 H(s)]* M* (s) 
or 
MO ETSI 
Since C(s) = G;(s)M* (s), we have 


Gi Gi * 


In terms of the z transform notation, 


G2(z )Gi R (z ) 
1+ G,G,H(z) 
This last equation gives the discrete-time output C(z). 
The continuous-time output C(s) can be obtained from the following equation: 
[Gi R(s)]* 
1+ [Gi G; H(s)]* 
Notice that [G; R(s)]*{1 + [G, G2 H(s)]*} is a series of impulses. The continuous-time 
output C(s) is the response of G;(s) to the sequence of such impulses. [See Problem 


A-3-18 for details of determining the continuous-time output c(t), the inverse Laplace 
transform of C(s).] 


C(z) = 


C(s) = Gr(s)M*(s) = G(s) 


Problem A-3-15 


Consider the system shown in Figure 3—57. Obtain the closed-loop pulse transfer 
function C(z)/R(z). Also, obtain the expression for C(s). 


Figure 3-57  Discrete-time control system. 
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Solution From the diagram we have 
C(s) = Ga(sM* (s) 
M(s) = Gi(s)E* (s) 
E(s) = R(s) — H(s)C(s) = R(s) — H(s)Go(s)M"* (s) 
Taking the starred Laplace transforms of both sides of the last three equations gives 
C*(s) = Gi(s)M*(s) 
M*(s) = Gi(s)E*(s) 
E*(s) = R*(s) - HG?(s)M*(s) 
Solving for C*(s) gives 
C* (s) = Gi(s)Gi(s)[R*(s) - HG2(s)M* (s)) 


or 
C*(s) = Gi(s)Gi(s)R*(s) — Gi(s)G?(s)HG3(s)M*(s) 
= Gt (s)GZ(s)R* (s) — Gt (sHGZ(s)C* (s) 
Thus, 
C*(s){1 + Gt(s)HG2(s)] = Gf(s)GZ2(s)R* (s) 
or 


C'(s) ^ Gf(s)G2() 
R*(s) 1+ G¥(s)HG3(s) 

In terms of the z transform notation, we have 
C(z) Giz)Gx2) 
R(z) 1+ G,(z)HG.(z) 

The continuous-time output C(s) can be obtained from the following equation: 
Gi(s)R*(s) 
1 + Gt(s)HGi(s) 


C(s) = Ga(s)M* (s) = G(s) 


Problem A-3-16 


Consider the analog PID controller and the digital PID controller. The equation for the 
analog PID controller is 


«| 
dt 


where e(t) is the input to the controller and m(t) is the output of the controller. The 
transfer function of the analog PID controller is 


G(s) = EG) - (: + a + Tas) 


The pulse transfer function of the digital PID controller in the positional form 
is as given by Equation (3-56): 
M(z) Ki; 


= Kp 
E(z) kr 1-2! 


m(t) = xe + $f eoa + Ty 


Gp(z) = 


T Kp(1 = z 


where Kp = K — iK. 
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Compare the polar plots (frequency-response characteristics) of the analog PID 
controller with those of the digital PID controller. 


Solution For the analog PID controller, the frequency-response characteristics can be 
obtained by substituting jw for s in G(s). Thus, 


: 1 F 
G(jo) = x(1 + Tjo + Tajo) 
.1 : 
= «a = TTo + Taja) (3-103) 


For the digital PID controller, the frequency-response characteristics can be 
obtained by substituting z = e/"" into Gp(z): 


A EEL Eq can 


1- eT 
=K ey E T + j sinwT) 
P | 1-coswT +j sinwT 2 2 J 
Kı 3 sin wT Mod 
= Kp + 2 ( pepe - + Kp(1 — coswT + j sinwT) (3-104) 


We shall first compare separately the P action, the 7 action, and the D action of 
the analog controller with their counterparts in the digital controller. Notice that in the 
proportional action (P action) the digital controller has a gain K;/2 less than the 
corresponding gain in the analog controller, since Kp = K — 1 Kr. See Figure 3-58(a). 

For the integral action (J action) the real parts of the polar plots of the analog 
controller and digital controller differ by K,/2, as shown in Figure 3—58(b). 

When the proportional action and integral action are combined, then the real 
parts of the polar plots for the analog PI action and the digital PI action become the 
same, as shown in Figure 3—58(c). 

The polar plots of the derivative action (D action) for the analog controller and 
the digital controller differ very much, as shown in Figure 3—58(d). Hence, there are 
considerable differences in the analog D action and the digital D action. 

The qualitative polar plot of the analog PID controller can be obtained from 
Equation (3-103) by varying « from 0 to œ, as shown in Figure 3-59(a). Similarly, the 
qualitative polar plot of the digital PID controller can be obtained from Equation 
(3-104) by varying w from 0 to z/T, as shown in Figure 3-59(b). 

Note that, although the polar plots of the analog PI controller and the digital PI 
controller are similar, there are significant differences between the polar plots of the 
analog PID controller and the digital PID controller. 


Problem A-3-17 


In Section 3-5 we derived the pulse transfer function for the PID controller in positional 
form. Referring to Figure 3-28, the pulse transfer function for the digital PID controller 
was derived as 


Using Vn(kT) = m(kT) — m((k — 1)T) derive the velocity-form PID control equation. 
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la) 


(b) 


lc) 


(d) 
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Im 


Analog P action 


Analog D action 


Re 


Im 


Kp 


Digital P action 


Digital D action 


(Kp * K - 3K) 


Re 


Figure 3-58 Polar plots of analog and digital controllers with (a) proportional 
action, (b) integral action, (c) proportional plus integral action, and (d) derivative 


action. 
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Analog PID controller Digital PID controller 


(a) (b) 


Figure 3-59 (a) Polar plot of analog PID controller; (b) polar plot of digital PID 
controller. 


Solution Note that 
Vm(kT) = m(kT) — m((k — 1)T) 


- klean - e((k — 1)T) + gr le(kT) + e((k — DT) 


eT) — 2e((k — 1)T) + e((k — an) 


= Kp[e(kT) — e((k — 1)T)] + Kre(kT) 
+ Kp [e(kT) — 2e((k — 1)T) + e((k — 2)T)] (3-105) 


where we have used the relationships Kp = K — 1K;, Kı = KT/T;, and Kp = KTJT. 
(For these relationships, refer to the derivations of the positional form of the digital PID 
control equation.) Equation (3-105) takes into consideration the variation of the 
positional form in one sampling period. 

Suppose the actuating error e(kT) is the difference between the input r(kT) and 
the output c(kT), or 


e(kT) = r(kT) — c(kT) 
By substituting this last equation into Equation (3-105), we obtain 
Vm(kT) = Kp[r(kT) — r((k — 1)T) — c(kT) + c((k — 1)7)] 
+ Ki[r(kT) — c(kT)] + Kp[r(kT) — 2r((k — DT) 
t r((k — DT) — c(kT) + 2c((k — 1)T) - c((k — 2)T)] (3-106) 
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The velocity-form PID control scheme given by Equation (3-106) may be modified into 
a somewhat different form to cope with sudden large changes in the set point. Since 
the proportional and derivative control actions produce a large change in the controller 
output when the signal entering the controller makes a sudden large change, to suppress 
such a large change in the controller output, the digital proportional and derivative 
terms may be modified as discussed next. 

If changes in the set point [input r(kT)] are a series of step changes, then 
immediately after a step change takes place, the input r(kT) stays constant for a while 
until the next step change takes place. Hence, in Equation (3-106) we assume that 


r(kT) = r((k — DT) = r((k — 2)T) 


(Note that this is true if the input stays constant. But we assume that this holds true 
even if a step change takes place.) Then Equation (3-106) may be modified to 


Vm(kT) = —Kp[c(kT) — c((k — 1)T)] + Ki[r(kT) — c(kT)] 
— Kp[c(kT) — 2c((k — 1)T) + c((k — 2)T)] (3-107) 
The z transform of Equation (3-107) gives 
(1 = 2 M(z) = -Ke(1 - z —)C(z) + Ki[R(z) - C(z)] 
— Kp(1 — 2z^! + z ?)C(z) 
Simplifying, we obtain 


R(z)-C 

EcL - Kp(1 — z ')C(z) (3-108) 
Equation (3-108) gives the velocity-form PID control scheme. The block diagram 
realization of the velocity-form digital PID control scheme was shown in Figure 3-30. 


M(z) = - Kr C(z) + Kı 


Problem A-3-18 


Consider the system shown in Figure 3-60(a). Obtain the continuous-time output c(t) 
so that the output between any two consecutive sampling instants can be determined. 
Find the expression for the continuous-time output c(t). The sampling period T is 1 sec. 


Solution For the system shown in Figure 3-60(a), we have 
C(s) = G(s)E* (s) 
E(s) = R(s) - C(s) 


Hence, 
E*(s) = R*(s) — C*(s) = R*(s) — G*(s)E*(s) 
or 
qo LEG) 
FGO-TrgG) 
Thus, 
C6) = 66 es 


The continuous-time output c(t) can therefore be obtained as the inverse Laplace 
transform of C(s): 
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(a) 


Individual impulse responses 


(bl 


c(t) 


@ Output points obtained 
by sample calculations 


0.5 


(c) 


Figure 3-60 (a) Discrete-time control system; (b) plots of individual impulse 
responses; (c) plot of continuous-time output c(t) versus t. 


c(t) = £'[cG) = zoo 22 | 


For the present system, 
e^ 1 


1 — 
G(s) = s s(s +1) 
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Hence, 
al-e" 1 R* (s) 
EN 1 
c) - 2 | s s(st1)1- 2 
Let us define 
-s__R*(s) 
* = — p^ 
X*6) = 0 OTF Sew 
Then the z transform expression for this last equation is 
-n _ RG) 
E — -l 
X=- TF E@ 
Referring to Equation (3-58) for the z transform of G(s), we obtain 
—1. 
1-z! 


X(2-20-z) 


1 0.36792 ^! + 0.26422 ? 
(1 - 0.36792 )(1— z ) 
.1- 1.3679z ^!  0.3679z ? 
1-z!-40.6321z ? 


Hence, noting that the sampling period T is 1 sec or T = 1, we have 


1 — 1.3679e^? + 0.3679e ^ 


XS) = Te + 0.63210 


Therefore, 


c(t) = £^ 1 1 — 1.3679e~* + 0.3679e ^ 
s(s+i) 1-e"-0.321e ^ 


1 
= -1 _ =s 1 —2s _ —3s 
L = +1) (1 — 0.3679e 0.6321e 0.3996e 


+ 0e~* + 0.2526e 5 + 0.2526e 5 + --- | 
Since 


—i 1 
s(st+1) s 


the inverse Laplace transform of this last equation is 
g|4—— |-r-1*e* 
s(s + 1) 
Hence, we obtain 


c(t) = (t — 1 + e^) ~ 0.3679[(t - 1) - 1 + e“Y]UE - 1) 
— 0.6321[(¢ — 2) - 1 + e? (t — 2) 
— 0.3996[(t — 3) — 1 + e ?]1(t — 3) 
+ 0.0000[(¢ —4) — 1 + e * ?ni(t — 4) 
+ 0.2526[(t — 5) — 1 +e }1(t — 5) 
+0.2526[(t — 6 —1 +e “%}1(t — 6) 


1,1 
s stl 
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(3-109) 


Chap. 3 Example Problems and Solutions 163 


Figure 3- 60(b) shows plots of individual impulse responses given by Equation (3-109). 
[Observe that c(t) consists of the sum of impulse responses that occur at ¢ = 0,1 = 1, 
t = 2,... with weighting factors 1, —0.3679, —0.6321,....] 

From Equation (3-109) we see that for time intervals 0x t < 1,1 xt «2, 
2=t<3,... the output c(r) is the sum of impulse responses as follows: 


t-lt+e, 0zt«1 

((-1*e75-0367[(—1) 14e *"l(tr-1, 1st<2 
c(t) =) (t - 1 + e^) — 0.3679[(t — 1) - 1 + e-*-"]i(t — 1) 

—0.6321[(¢ — 2) - 1 + e-*-?]1(t — 2), 2<1<3 


Sample calculations for several values of t follow: 
c(0) =0-1+1=0 

c(0.5) = 0.5 — 1 + 0.6065 = 0.1065 

c(1.0) = 0.3679 — 0.3679 x 0 = 0.3679 

c(1.5) = 0.7231 — 0.3679 x 0.1065 = 0.6839 

c(2.0) = 1.1353 — 0.3679 x 0.3679 = 1.0000 

c(2.5) = 1.5821 — 0.3679 x 0.7231 — 0.6321 x 0.1065 = 1.2487 

c(3.0) = 2.0498 — 0.3679 x 1.1353 — 0.6321 x 0.3679 = 1.3996 

c(4.0) = 3.0183 — 0.3679 x 2.0498 — 0.6321 x 1.1353 — 0.3996 x 0.3679 = 1.3996 

c(5.0) = 4.0067 — 0.3679 x 3.0183 — 0.6321 x 2.0498 — 0.3996 x 1.1353 
+0 x 0.3679 = 1.1469 

c(6.0) — 5.0025 — 0.3679 x 4.0067 — 0.6321 x 3.0183 — 0.3996 x 2.0498 
+0 x 1.1353 + 0.2526 x 0.3679 = 0.8944 


The continuous-time output c(t) thus obtained is plotted in Figure 3—-60(c). 
Problem A-3-19 

Consider the digital filter defined by 
Y(z  4(z-1)(z-12z + 1) 
X(z) (z +: 0.1)(z? — 0.3z + 0.8) 


Draw a series realization diagram and a parallel realization diagram. (Use one first- 
order section and one second-order section.) 


G(z) = 


Solution We shall first consider the series realization scheme. To limit the coefficients 
to real quantities, we group the second-order term in the numerator (which has complex 
zeros) and the second-order term in the denominator (which has complex poles). 
Hence, we group G(z) as follows: 

z-1 274+1.2z+1 
z *0.1z? — 0.3z + 0.8 

1-z' 1-12z'«*z? 
1+ 0.12711 — 0.327! + 0.82 ? 


Figure 3-61(a) shows a series realization diagram. 


G(z) =4 


=4 
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(a) 


46.61905 


4.04762 


(b) 


Figure3-61 Block diagram realizations of the digital filter considered in Problem 
A-3-19. (a) Series realization; (b) parallel realization. 
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Next, we shall consider the parallel realization scheme. Expansion of G(z)/z into 
partial fractions gives 
G(z . 4( — A(z? + 1.2z + 1) 
z z(z + 0.1)(z? — 0.3z + 0.8) 


979 155 85 
_ 50 a a2 tt 


z z*01 z-03z-08 


Then G(z) can be written as follows: 


46.61905 7.38095 + 4.04762 ! 


GG)- -50 +7701: 70327 + 0822 


Figure 3-61(b) shows a parallel realization diagram. 


Problem A—3—20 


A slowly changing continuous-time signal x(t) is sampled every T sec. Assume that 
changes in signal x(f) are very slow compared to the sampling frequency. Show that in 
the z plane (1 — z~')/T corresponds to "differentiation," just as s corresponds to 
“differentiation” in the s plane. 


Solution For a slowly changing signal x(t), the derivative of x(t) can be approximated 
by 


.dx( 1 _ _ 
wo = SE = gb) - x(k - DT) 
The z transform of this equation gives 
VG) = FIXE) - z^ XG)] = FOL - 2 XW) 
from which we obtain the block diagram shown in Figure 3-62(a). This diagram 
corresponds to the 5 plane differentiation shown in Figure 3-62(b). Note that the block 


diagram shown in Figure 3-62(a) can be modified to that shown in Figure 3-63. (For 
approximation of "integration" in the z plane, see Problems B-3-25 through B-3—27.) 


xia 1 viz) Xis) Vs) 


(a) (b) 


Figure 3-62 (a) Block diagram for “differentiation” in the z plane; (b) block 
diagram for "differentiation" in the s plane. 


Figure 3-63 Approximate 
“differentiator” in the z plane. 
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PROBLEMS 


Problem B—3-1 
Show that the circuit shown in Figure 3—64 acts as a zero-order hold. 


R; « R, 


Figure 3-64 Circuit approximating a zero-order hold. 


Problem B—3-2 


Consider the circuit shown in Figure 3-65. Derive a difference equation describing the 
system dynamics when the input voltage applied is piecewise constant, or 


e(t) - e(kT), | kT S t « (Kk - I)T 


e(t) [^ xit) 


Figure 3-65 RC circuit. 


(Derive first a differential equation and then discretize it to obtain a difference equa- 
tion.) 


Problem B—-3-3 


Consider the impulse sampler and first-order hold shown in Figure 3-66. Derive the 
transfer function of the first-order hold, assuming a unit-ramp function as the input x(t) 
to the sampler. 


First-order 
hold Figure 3-66 Impulse sampler and first- 


order hold. 
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Problem B-3-4 
Consider a transfer function system 


s+3 
(s + 1)(s + 2) 


Obtain the pulse transfer function by two different methods. 


Problem B—3—5 


Obtain the z transform of 


X(s) = 


TAMEN ET 
(s + a)(s + b) 


Use the residue method and the method based on the impulse response function. 
Problem B—-3-6 
Obtain the z transform of 


X(s) = 


bee A 
XO) = 5 Gray 
Problem B-3—7 
Consider the difference equation system 
y(k + 1) + O.Sy(k) = x(k) 


where y(0) = 0. Obtain the response y(k) when the input x(k) is a unit-step sequence. 
Also, obtain the MATLAB solution. 


Problem B-3-8 
Consider the difference equation system 
y(k + 2) + y(k) = x(k) 


where y(k) = 0 for k < 0. Obtain the response y(k) when the input x(k) is a unit-step 
sequence. Also, obtain the MATLAB solution. 


Problem B-3-9 
Obtain the weighting sequence g(k) of the system described by the difference equation 
y(k) — ay(k — 1) = x(k), -l<a<i 
If two systems described by this last equation are connected in series, what is the 
weighting sequence of the resulting system? 
Problem B-3-10 
Consider the system described by 
y(k) — y(k — 1) + 0.24y(k — 2) = x(k) + x(k — 1) 
where x(k) is the input and y(k) is the output of the system. 
Determine the weighting sequence of the system. Assuming that y(k) = 0 for 


k < 0, determine the response y(&) when the input x(k) is a unit-step sequence. Also, 
obtain the MATLAB solution. 


Problem B-3-11 


Consider the system 
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1-0.5z7! 
GG) = n7 93z3y0 € 0325 


Obtain the response of this system to a unit-step sequence input. Also, obtain the 
MATLAB solution. 


Problem B-3—12 
Obtain the response y(kT) of the following system: 
Y(s) _ 1 
X*(s) (st 1)(s + 2) 


where x(t) is the unit-step function and x*(t) is its impulse-sampled version. Assume 
that the sampling period T is 0.1 sec. 
Problem B—3-13 
Consider the system defined by 
Y(z) 0.5z° + 0.4127z? + 0.1747z — 0.0874 
= A(z) = = 
U(z) z 


Using the convolution equation 


k 
y(k) = 2 h(k - Du) 
j- 
obtain the response y(k) to a unit-step sequence input u(k). 


Problem B-3-14 


Assume that a sampled signal X* (s) is applied to a system G(s). Assume also that the 
output of G(s) is Y(s) and y(0+) = 0. 


Y(s) = G(s)X*(s) 
Using the relationship 
Y'() 2 4 X YG + juk) 
k--—o 
show that 
Y*(s) = G*(s)X*(s) 


Problem B-3—-15 


Obtain the closed-loop pulse transfer function of the system shown in Figure 3-67. 


Figure 3-67  Discrete-time control system. 
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Problem B-3-16 


Obtain the closed-loop pulse transfer function of the system shown in Figure 3—68. 


Figure 3-68  Discrete-time control system. 


Problem B~3—17 


Consider the discrete-time control system shown in Figure 3-69. Obtain the discrete- 
time output C(z) and the continuous-time output C(s) in terms of the input and the 
transfer functions of the blocks. 


Figure 3-69  Discrete-time control system. 


Problem B-3-18 


Consider the discrete-time control system shown in Figure 3-70. Obtain the output 
sequence c(kT) of the system when it is subjected to a unit-step input. Assume that the 
sampling period T is 1 sec. Also, obtain the continuous-time output c(t). 


Figure 3-70  Discrete-time control system. 
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Problem B-3-19 


Obtain in a closed form the response sequence c(KT) of the system shown in Figure 3-71 
when it is subjected to a Kronecker delta input r(k). Assume that the sampling period 
T is 1 sec. 


Figure 3-71 Discrete-time control system. 


Problem B-3-20 


Consider the system shown in Figure 3-72. Assuming that the sampling period T is 0.2 
sec and the gain constant K is unity, determine the response c(kT) for k = 0, 1, 2, 3, 
and 4 when the input r(ż) is a unit-step function. Also, determine the final value c(%). 


Figure 3-72  Discrete-time control system. 


Problem B-3-21 
Obtain the closed-loop pulse transfer function C(z)/R(z) of the digital control system 
shown in Figure 3-30. Assume that the pulse transfer function of the plant is G(z). 
(Note that the system shown in Figure 3-30 is a velocity-form PID control of the plant.) 
Problem B-3-22 
Assume that a digital filter is given by the following difference equation: 
y(k) + aiy(k — 1) + azy(k — 2) = bix(k) + box(k — 1) 
Draw block diagrams for the filter using (1) direct programming, (2) standard program- 
ming, and (3) ladder programming. 
Problem B-3-23 
Consider the digital filter defined by 


2 + 2.2z71 + 0.2z~? 
GG) - TY 04 0.122 
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Realize this digital filter in the series scheme, the parallel scheme, and the ladder 
scheme. 

Problem B-3—-24 
Referring to the approximate differentiator shown in Figure 3-63, draw a graph of the 
output v(k) versus k when the input x(k) is a unit-step sequence. 

Problem B-3-25 


Consider the system shown in Figure 3—73. Show that the pulse transfer function 


Y(z)/X(z) is given by 


Figure 3-73 Digital integrator without delay. 


Assuming that y(kT) = 0 for k « 0, show that 
y(kT) = T[x(0) + x(T) +- + x(kT)] 


Thus, the output y(kT) approximates the area made by the input. Hence, the system 

acts as an integrator. Because y(0) = Tx(0), the output appears as soon as x(0) enters 

the system. This integrator is commonly called a digital integrator without delay. 
Draw a graph of the output y(kT) when the input x(KT) is a unit-step sequence. 


Problem B—3—26 


Consider the system shown in Figure 3-74. Show that the pulse transfer function 
Y(zyX(z) is given by 


Figure 3-74 Digital integrator with delay. 


Assuming that y(kT) — 0 for k « 0, show that 
y(kT) = T[x(0) + x(T) + +++ + x((k — DT)] 
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The output y(kT) approximates the area made by the input. Since y(0) = 0 and 
y(T) = Tx(0), the output starts to appear at t = T. This integrator is called a digital 
integrator with delay. 
Draw a graph of the output y(kT) when the input x(KkT) is a unit-step sequence. 
Problem B-3-27 


Consider the system shown in Figure 3-75. Show that the pulse transfer function 


Y(z)/X(z) is given by 
Y() _ z Doz 
X) 2M-z! 1-z!| 


This system is a combination of the digital integrators without delay and with delay, as 
presented in Problems B-3-25 and B-3-26, respectively. 


Figure 3-75 Digital bilinear integrator. 


Assuming that y(kT) = 0 for k < 0, obtain y(KT) in terms of x(0), x(T),..., 
x(KT). This integrator is called a digital bilinear integrator. Draw a graph of the output 
y(kT) when the input x(KT) is a unit-step sequence. 


4 


Design of Discrete-Time 
Control Systems by 
Conventional Methods 


4-1 INTRODUCTION 


In this chapter we first present mapping from the s plane to the z plane and then 
discuss stability of closed-loop control systems in the z plane. Next we treat three 
different design methods for single-input-single-output discrete-time or digital con- 
trol systems. The first method is based on the root-locus technique using pole-zero 
configurations in the z plane. The second method is based on the frequency-response 
method in the w plane. The third method is an analytical method in which we attempt 
to obtain a desired behavior of the closed-loop system by manipulating the pulse 
transfer function of the digital controller. 

Design techniques for continuous-time control systems based on conventional 
transform methods (the root-locus and frequency-response methods) have become 
well established since the 1950s. Conventional transform methods are especially 
useful for designing industrial control systems. In fact, in the past, many industrial 
digital control systems were successfully designed on the basis of conventional 
transform methods. Both familiarity with the root-locus and frequency-response 
techniques and experiences gained in the design of analog controllers are immensely 
valuable in designing discrete-time control systems. 


Outline of the Chapter. Section 4-1 has presented introductory material. 
Section 4-2 treats mapping from the s plane to the z plane. Section 4-3 discusses 
the Jury stability criterion for closed-loop control systems in the z plane. Section 4—4 
summarizes transient and steady-state response characteristics of discrete-time con- 
trol systems. The design technique based on the root-locus method is presented in 
Section 4—5. Section 4—6 first reviews the frequency-response method and then 
presents frequency-response techniques using the w transformation for designing 
discrete-time control systems. Section 4—7 treats an analytical design method. 
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4-2 MAPPING BETWEEN THE s PLANE AND THE z PLANE 


The absolute stability and relative stability of the linear time-invariant continuous- 
time closed-loop control system are determined by the locations of the closed-loop 
poles in the s plane. For example, complex closed-loop poles in the left half of the 
s plane near the jw axis will exhibit oscillatory behavior, and closed-loop poles on 
the negative real axis will exhibit exponential decay. 

Since the complex variables z and s are related by z = e”, the pole and zero 
locations in the z plane are related to the pole and zero locations in the s plane. 
Therefore, the stability of the linear time-invariant discrete-time closed-loop system 
can be determined in terms of the locations of the poles of the closed-loop pulse 
transfer function. It is noted that the dynamic behavior of the discrete-time control 
system depends on the sampling period T. In terms of poles and zeros in the z plane, 
their locations depend on the sampling period T. In other words, a change in the 
sampling period T modifies the pole and zero locations in the z plane and causes the 
response behavior to change. 


Mapping of the Left Half of the s Plane into the z Plane. In the design of a 
continuous-time control system, the locations of the poles and zeros in the s plane 
are very important in predicting the dynamic behavior of the system. Similarly, in 
designing discrete-time control systems, the locations of the poles and zeros in the 
z plane are very important. In the following paragraphs we shall investigate how the 
locations of the poles and zeros in the s plane compare with the locations of the poles 
and zeros in the z plane. 

When impulse sampling is incorporated into the process, the complex variables 
z and s are related by the equation 


z =e” 
This means that a pole in the s plane can be located in the z plane through the 
transformation z = e^. Since the complex variable s has real part ø and imaginary 
part w, we have 


S=atjo 
and 


z = elt i9) 5 ele pile = To o To + 2k) 


From this last equation we see that poles and zeros in the s plane, where frequencies 
differ in integral multiples of the sampling frequency 27/T, are mapped into the same 
locations in the z plane. This means that there are infinitely many values of s for each 
value of z. 

Since a is negative in the left half of the s plane, the left half of the s plane 
corresponds to 


lz) = e'* «1 


The jw axis in the s plane corresponds to |z| = 1. That is, the imaginary axis in the 
s plane (the line o = 0) corresponds to the unit circle in the z plane, and the interior 
of the unit circle corresponds to the left half of the s plane. 


DU 
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Primary Strip and Complementary Strips. Note that since /z = wT the angle 
of z varies from —% to o as w varies from —^ to œ. Consider a representative point 
on the jw axis in the s plane. As this point moves from —j3 o, to j} œ; on the jw axis, 
where w, is the sampling frequency, we have |z| = 1, and £z varies from —7 to 7 
in the counterclockwise direction in the z plane. As the representative point moves 
from j1 c, to j3@, on the jw axis, the corresponding point in the z plane traces out 
the unit circle once in the counterclockwise direction. Thus, as the point in the s plane 
moves from — to % on the jw axis, we trace the unit circle in the z plane an infinite 
number of times. From this analysis, it is clear that each strip of width œ, in the left 
half of the s plane maps into the inside of the unit circle in the z plane. This implies 
that the left half of the s plane may be divided into an infinite number of periodic 
strips as shown in Figure 4-1. The primary strip extends from jw = —j}a, to ji os. 
The complementary strips extend from jc, to j3@,, j3@, to j3@,,..., and from 
—jia, to -jiw -jio to —jF@,,.... 

In the primary strip, if we trace the sequence of points 1-2-3-4-5-1 in the s 
plane as shown by the circled numbers in Figure 4—2(a), then this path is mapped 
into the unit circle centered at the origin of the z plane, as shown in Figure 4—2(b). 
The corresponding points 1, 2, 3, 4, and 5 in the z plane are shown by the circled 
numbers in Figure 4—2(b). 

The area enclosed by any of the complementary strips is mapped into the same 
unit circle in the z plane. This means that the correspondence between the z plane 


fw 
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H ws 
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Figure 4-1 Periodic strips in the s plane and the corresponding region (unit circle 
centered at the origin) in the z plane. 
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z plane 
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Figure 4-2 Diagrams showing the correspondence between the primary strip in the 
s plane and the unit circle in the z plane: (a) a path in the s plane; (b) the 
corresponding path in the z plane. 


and thes plane is not unique. A point in the z plane corresponds to an infinite number 
of points in the s plane, although a point in the s plane corresponds to a single point 
in the z plane. 

Since the entire left half of the s plane is mapped into the interior of the unit 
circle in the z plane, the entire right half of the s plane is mapped into the exterior 
of the unit circle in the z plane. As mentioned earlier, the jw axis in the s plane maps 
into the unit circle in the z plane. Note that, if the sampling frequency is at least twice 
as fast as the highest-frequency component involved in the system, then every point 
in the unit circle in the z plane represents frequencies between —4 w, and $ w. 

In what follows we shall investigate the mapping of some of the commonly 
used contours in the s plane into the z plane. Specifically, we shall map constant- 
attenuation loci, constant-frequency loci, and constant-damping-ratio loci. 


Constant-Attenuation Loci. A constant-attenuation line (a line plotted as 
g = constant) in the s plane maps into a circle of radius z = e" centered at the origin 
in the z plane, as shown in Figure 4-3. 


Settling Time t, The settling time is determined by the value of attenuation 
c of the dominant closed-loop poles. If the settling time is specified, it is possible 
to draw a line ø = —o; in the s plane corresponding to a given settling time. The 
region to the left of the line o = -o in the s plane corresponds to the inside of a 
circle with radius e^"! in the z plane, as shown in Figure 4-4. 


Constant-Frequency Loci. A constant-frequency locus w = o, in the s plane 
is mapped into a radial line of constant angle Tw, (in radians) in the z plane, as shown 
in Figure 4-5. Note that constant-frequency lines at o = +4 «w, in the left half of the 
s plane correspond to the negative real axis in the z plane between 0 and —1, since 
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s plane z plane 


fal (b) 


Figure4-3 (a) Constant-attenuation lines in the s plane; (b) the corresponding loci 
in the z plane. 


T(+4,) = +7. Constant-frequency lines at w = +}, in the right half of the s plane 
correspond to the negative real axis in the z plane between —1 and —o. The negative 
real axis in the s plane corresponds to the positive real axis in the z plane between 
0 and 1. And constant frequency lines at o = no, (n = 0,1,2,...)in the right half 
of the s plane map into the positive real axis in the z plane between 1 and œ. 

The region bounded by constant-frequency lines w = w and w = —a» (where 
both w, and w lie between —} w, and $ œ) and constant-attenuation lines y = —o, 
and o = —o», as shown in Figure 4—6(a), is mapped into a region bounded by two 
radial lines and two circular arcs, as shown in Figure 4—6(b). 


m 


s plane 


ta) (b) 


Figure 4-4 (a) Region for settling time T, less than 4/a, in the s plane; (b) region 
for settling time 7, less than 4la in the z plane. 
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ze z=e 


(a) (b) 
Figure4-5 (a) Constant-frequency lociin thes plane; (b) the corresponding loci in the z plane. 
Constant-Damping-Ratio Loci. A constant-damping-ratio line (a radial line) 


in the s plane is mapped into a spiral in the z plane. This can be seen as follows. In 
the s plane a constant-damping-ratio line can be given by 


S = —£o, t jo, V1 — C = - (o, + jo 


Im z plane 
s plane 


Ja PAU + je) 


E 


B 


(a) (b) 


Figure 4-6 (a) Region bounded by lines w = œ, w = —a,, € = —0;, and g = —o,in thes 
plane; (b) the corresponding region in the z plane. 


Sec. 4-2 Mapping Between the s Plane and the z Plane 179 


where wy = «e, V1 — £ [see Figure 4—7(a)]. In the z plane this line becomes 
z =e" = exp(-£o, T + jo, T) 


276 wa + jon) 
w 


= ap- = ü "m 


S 


Hence, 
2T 
zl = exe iS) 4-1) 
and 
— 9-H E 
[z= 207 (4-2) 


S 


Thus, the magnitude of z decreases and the angle of z increases linearly as w, 
increases, and the locus in the z plane becomes a logarithmic spiral, as shown in 
Figure 4-7(b). 

Notice that for a given ratio of w,/w, the magnitude |z| becomes a function only 
of £, and the angle of z becomes a constant. For example, if the damping ratio is 
specified as 0.3, or ¢ = 0.3, then for w4 = 0.25w, we have 


"E exp(- 22202. x 0.25) = 0.610 


ZZ = Um x 0.25 = 0.57 = 90° 


Constant 
Constant-damping- jw f locus 
ratio line 


s plane 


z plane 


(a) (b) 


Figure 4-7 (a) Constant-damping-ratio line in the s plane; (b) the corresponding locus in the 
z plane. 
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For w; = 0.5a,, 


l| = ep- 2203, x os) - 0.3725 


Lz = 2r X 0.5 = m = 180° 


Thus, the spiral can be graduated in terms of a normalized frequency w,/w, [see 
Figure 4—7(b)]. Once the sampling frequency o, is specified, the numerical value of 
@, at any point on the spiral can be determined. For example, at point P in Figure 
4—7(b), wa can be determined as follows. If, for example, the sampling frequency is 
specified as œ, = 107 rad/sec, then at point P 


T 


Wa 
[z= 57 2r% 
6 w; 
Hence, w, at point P is 
wa = $o, = 2T rad/sec 


Note that if a constant-damping-ratio line is in the second or third quadrant 
in the s plane then the spiral decays within the unit circle in the z plane. However, 
if a constant-damping-ratio line is in the first or fourth quadrant in the s plane (which 
corresponds to negative damping), then the spiral grows outside the unit circle. 
Figure 4—8 shows constant-damping-ratio loci for £ = 0, 4 = 0.2, £ = 0.4, £ = 0.6, 
¢ = 0.8, and ¢ = 1. The ¢ = 1 locus is a horizontal line between points z = 0 and 
z = 1. (Note that Figure 4-8 shows only the loci in the upper half of the z plane, 
which correspond to 0 = w = }a,. The loci corresponding to —4@, = w = 0 are the 
mirror images of the loci in the upper half of the z plane about the horizontal axis.) 

Notice that the constant ¢ loci are normal to the constant c, loci in the s plane, 
as shown in Figure 4—9(a). In the z plane mapping, constant œw, loci intersect constant 
£ spirals at right angles, as shown in Figure 4-9(b). A mapping such as this, which 
preserves both the size and the sense of angles, is called a conformal mapping. 


-1.0 -0.5 0 =i 0.5 1.0 Re 
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Figure 4-9 (a) Diagram showing orthogonality of the constant £ loci and constant c, loci in 
the s plane; (b) the corresponding diagram in the z plane. 


s Plane and z Plane Regions for £ >. Figure 4-10 shows constant ¢ loci 
(£ = 4) in both the s plane and the z plane. Note that the logarithmic spirals shown 
correspond to the primary strip in the s plane. (If the sampling theorem is satisfied, 
then we need to consider only the primary strip in the s plane.) 

If all the poles in the s plane are specified as having a damping ratio not less 
than a specified value £4, then the poles must lie to the left of the constant-damping 
ratio line in the s plane (the shaded region). In the z plane, the poles must lie in the 
region bounded by logarithmic spirals corresponding to £ = £i (the shaded region). 


Example 4-1 
Specify the region in the z plane that corresponds to a desirable region (shaded region) 
in the s plane bounded by lines w = +a, lines ¢ = £i, and a line o = —a, as shown 


in Figure 4-11(a). 


s plane 


(b) 


(a) 
Figure4-10 (a) Region for ¢ > ¢,in the s plane; (b) region for ¢ > &inthez plane. 
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Figure 4-11 (a) A desirable region in the s plane for closed-loop pole locations; 
(b) corresponding region in the z plane. 


On the basis of the preceding discussions on mapping from the s plane to the z 
plane, the desirable region can be mapped to the z plane as in Figure 4-11(b). 

Note that if the dominant closed-loop poles of the continuous-time control sys- 
tem are required to be in the desirable region specified in the s plane, then the domi- 
nant closed-loop poles of the equivalent discrete-time control system must lie inside the 
region in the z plane that corresponds to the desirable region in the s plane. Once the 
discrete-time control system is designed, the system response characteristics must be 
checked by experiments or simulation. If the response characteristics are not satisfac- 
tory, then closed-loop pole and zero locations must be modified until satisfactory results 
are obtained. 


Comments. For discrete-time control systems, it is necessary to pay particular 
attention to the sampling period T. This is because, if the sampling period is too long 
and the sampling theorem is not satisfied, then frequency folding occurs and the 
effective pole and zero locations will be changed. 

Suppose a continuous-time control system has closed-loop poles at 
s=- ci + jw in the s plane. If the sampling operation is involved in this system and 
if c > 1o,, where o, is the sampling frequency, then frequency folding occurs and 
the system behaves as if it had poles at s = —o, + j(w,; + nw,), where n = 1,2, 
3,.... This means that the sampling operation folds the poles outside the primary 
strip back into the primary strip, and the poles will appear ats = —o, + j(w, — w); 
see Figure 4-12(a). On the z plane those poles are mapped into one pair of conjugate 
complex poles, as shown in Figure 4-12(b). When frequency folding occurs, oscilla- 
tions with frequency w, — œ, rather than frequency w, are observed. 


4-3 STABILITY ANALYSIS OF CLOSED-LOOP SYSTEMS 
IN THE z PLANE 


Stability Analysis of a Closed-Loop System. In what follows we shall discuss 
the stability of linear time-invariant single-input-single-output discrete-time control 
systems. Consider the following closed-loop pulse-transfer function system: 
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Figure 4-12 (a) Diagram showing s plane poles at -o + jw, and folded poles 
appearing at —o, + j(w, + w), — a + j(@ + 2o), ...; (b) z plane mapping of s 
plane poles at —o, + jwn — o; + f(a t w), — a1 + (mi £ 20,),... 


C(z2 CQ) 
R(z) 1+ GH(z) 


(4-3) 


The stability of the system defined by Equation (4-3), as well as of other types of 
discrete-time control systems, may be determined from the locations of the closed- 
loop poles in the z plane, or the roots of the characteristic equation 


P(z) =1+ GH(2) =0 


as follows: 


1. 


For the system to be stable, the closed-loop poles or the roots of the charac- 
teristic equation must lie within the unit circle in the z plane. Any closed-loop 
pole outside the unit circle makes the system unstable. 

If a simple pole lies at z = 1, then the system becomes critically stable. Also, 
the system becomes critically stable if a single pair of conjugate complex poles 
lies on the unit circle in the z plane. Any multiple closed-loop pole on the unit 
circle makes the system unstable. 

Closed-loop zeros do not affect the absolute stability and therefore may be 
located anywhere in the z plane. 


Thus, a linear time-invariant single-input-single-output discrete-time closed- 


loop control system becomes unstable if any of the closed-loop poles lies outside the 
unit circle and/or any multiple closed-loop pole lies on the unit circle in the z plane. 
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Example 4-2 
Consider the closed-loop control system shown in Figure 4—13. Determine the stability 
of the system when K = 1. The open-loop transfer function G(s) of the system is 
faves 1 


ee s s(s +1) 


Referring to Equation (3-58), the z transform of G(s) is 
l-e* 1 _ 0.36792 + 0.2642 

s s(st+1) (z — 0.3679)(z — 1) 
Since the closed-loop pulse transfer function for the system is 


CZ) | Gz) 
R(z) 1+ G(z) 


G(z) = 2| (4-4) 


the characteristic equation is 

1+ G(z) =90 
which becomes 

(z — 0.3679)(z — 1) + 0.3679z + 0.2642 = 0 
or 
z? — z + 0.6321 = 0 
The roots of the characteristic equation are found to be 
zı = 0.5 + j0.6181, z2 = 0.5 — j0.6181 

Since 

la] = [zi <1 


the system is stable. 


It is important to note that in the absence of the sampler a second-order system 
is always stable. In the presence of the sampler, however, a second-order system such 
as this can become unstable for large values of gain. In fact, it can be shown that 
the second-order system shown in Figure 4-13 will become unstable if K > 2.3925. 
(See Example 4-7.) 


Methods for Testing Absolute Stability. Three stability tests can be applied 
directly to the characteristic equation P(z) = 0 without solving for the roots. Two 
of them are the Schur-Cohn stability test and the Jury stability test. These two tests 


le 
s(s +1) 


Figure 4-13 Closed-loop control system of Example 4-2. 


noi 
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reveal the existence of any unstable roots (the roots that lie outside the unit circle 
in the z plane). However, these tests neither give the locations of unstable roots nor 
indicate the effects of parameter changes on the system stability, except for the 
simple case of low-order systems. (See Example 4-7.) The third method is based on 
the bilinear transformation coupled with the Routh stability criterion, which will be 
outlined later in this section. (In Chapter 5 we discuss Liapunov stability analysis, 
which is applicable to control systems defined in state space.) 

Both the Schur-Cohn stability test and the Jury stability test may be applied 
to polynomial equations with real or complex coefficients. The computations re- 
quired in the Jury test, when the polynomial equation involves only real coefficients, 
are much simpler than those required in the Schur-Cohn test. Since the coefficients 
of the characteristic equations corresponding to physically realizable systems are 
always real, the Jury test is preferred to the Schur-Cohn test. 


The Jury Stability Test. In applying the Jury stability test to a given charac- 
teristic equation P(z) = 0, we construct a table whose elements are based on the 
coefficients of P(z). Assume that the characteristic equation P(z) is a polynomial 
in z as follows: 


P(z) = aoz” + az" +++ + daz + d, (4-5) 


where a) > 0. Then the Jury table becomes as given in Table 4-1. 

Notice that the elements in the first row consist of the coefficients in P(z) 
arranged in the ascending order of powers of z. The elements in the second row 
consist of the coefficients of P(z) arranged in the descending order of powers of z. 
The elements for rows 3 through 2n — 3 are given by the following determinants: 


TABLE 4-1 GENERAL FORM OF THE JURY STABILITY TABLE 


[ Row z? zi z? 
1 Qn Gn -1 Qn -2 
2 do ay ae 


3 bs -1 ba -2 bn -3 


4 bo bi ba 


2n — 5 P3 P2 pi 


2n —4 Po Pi P2 
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b, = dn n-i- k =0,1,2,...,.n -1 
ao k+ 
_ ba b, 2s EI = 
Ck = bo by > k —0,1,2,...,n 2 
— [Ps P2-k k =0,1,2 
qx Po P+ , n 


Note that the last row in the table consists of three elements. (For second-order 
systems, 2n — 3 — 1 and the Jury table consists only of one row containing three 
elements.) Notice that the elements in any even-numbered row are simply the 
reverse of the immediately preceding odd-numbered row. 


Stability Criterion by the Jury Test. A system with the characteristic equation 
P(z) = 0 given by Equation (4—5), rewritten as 
P(z)—az'taz"-4---ctajaiz-a, 


where a, > 0, is stable if the following conditions are all satisfied: 


» lel < ao 
. P(z)) > 0 

>0 for n even 
P(z)b-- «0 for n odd 
Ib. i| > [Bol 


le«-2] > leo] 


1 
2 
3 
4 


lqz| > lal 
Example 4-3 
Construct the Jury stability table for the following characteristic equation: 
P(z) = @z* + az? taz + azz + a, 


where ao > 0. Write the stability conditions. 

Referring to the general case of the Jury stability table given by Table 4-1, a J ury 
stability table for the fourth-order system may be constructed as shown in Table 4-2. 
This table is slightly modified from the standard form and is convenient for the compu- 
tations of the b's and c's. The determinant given in middle of each row gives the value 
of b or c written on the right-hand side of the same row. 

The stability conditions are as follows: 


1. |as| < ao 

2. P(1) - aot ai a@+4a,+4a,>0 

3. P(-1) = ao — a, + à — a + a4 > O, n —4 = even 
4. |bs|  |be| 


lez} > [eo] 
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TABLE 4-2 JURY STABILITY TABLE FOR THE FOURTH-ORDER SYSTEM 


It is noted that the value of c, (or, in the case of the nth-order system, the value 
of qı) is not used in the stability test, and therefore the computation of c; (or qi) may 
be omitted. 


Example 4-4 
Examine the stability of the following characteristic equation: 


P(z) = z! - 122 + 0.072? + 0.3z — 0.08 = 0 


Notice that for this characteristic equation 


a = 1 

a, = —1.2 
à; = 0.07 
a; = 0.3 

a4 = —0.08 


Clearly, the first condition, |a4| < ao, is satisfied. Let us examine the second condition 
for stability: 


P(1) = 1 — 1.2 + 0.07 + 0.3 — 0.08 = 0.09 > 0 
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The second condition is satisfied. The third condition for stability becomes 
P(-1)-1- 1.2 + 0.07 — 0.3 — 0.08 = 1.89 > 0, n = 4 = even 


Hence the third condition is satisfied. 

We now construct the Jury stability table. Referring to Example 4-3, we compute 
the values of bs, b2, bi, and bo and c; and co. The result is shown in Table 4-3. (Although 
the value of c; is shown in the table, c; is not needed in the stability test and therefore 
need not be computed.) From this table, we get 


[bs| = 0.994 > 0.204 = |bo| 

leal = 0.946 > 0.315 = lco| 
Thus both parts of the fourth condition given in Example 4—3 are satisfied. Since all 
conditions for stability are satisfied, the given characteristic equation is stable, or all 
roots lie inside the unit circle in the z plane. 


As a matter of fact, the given characteristic equation P(z) can be factored as 
follows: 


P(z) = (z — 0.8)(z + 0.5)(z — 0.5)(z — 0.4) 
As a matter of course, the result obtained above agrees with the fact that all roots are 
within the unit circle in the z plane. 


TABLE 4-3 JURY STABILITY TABLE FOR THE SYSTEM OF EXAMPLE 4-4 


= b2= 1.176 


= c2 = 0.946 
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Example 4-5 
Examine the stability of the characteristic equation given by 
P(z) = 22 - 1.12? -0.1z + 0.2 =0 


First we identify the coefficients: 


a = 1 

a = -1.1 
a = —0.1 
a = 0.2 


The conditions for stability in the Jury test for the third-order system are as follows: 
1. las| < do 
2. P(1)»0 
3. P(-1) <0, n = 3 = odd 
4. |b2| > |bo| 


The first condition, |as| < ao, is clearly satisfied. Now we examine the second condition 
of the Jury stability test: 


P(1)21-11-0.1—-0.220 
This indicates that at least one root is atz = 1. Therefore, the system is at best critically 
stable. The remaining tests determine whether the system is critically stable or unstable. 
(If the given characteristic equation represents a control system, critical stability will 


not be desired. The stability test may be stopped at this point.) 
The third condition of the Jury test gives 


P(-1)2-1-11-40.1-02--18«0, n-3- odd 


The third condition is satisfied. Now we examine the fourth condition of the Jury test. 
Simple computations give b; = —0.96 and b, = —0.12. Hence, 


|b2| > [bol 
The fourth condition of the Jury test is satisfied. 
From the above analysis we conclude that the given characteristic equation has 


one root on the unit circle (z = 1) and its other two roots within the unit circle in the 
z plane. Hence, the system is critically stable. 


Example 4-6 
A control system has the following characteristic equation: 
P(z) = z? — 1.32? — 0.082 + 0.24 = 0 


Determine the stability of the system. 
We first identify the coefficients: 


ap = 1 
a= -1.3 
a. = —0.08 


3 = 0.24 
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Clearly, the first condition for stability, |a| < ao, is satisfied. Next, we examine the 
second condition for stability: 


P(121-—1.3-—0.08-- 0.24 = -0.14 < 0 


The test indicates that the second condition for stability is violated. The system is 
therefore unstable. We may stop the test here. 


Example 4-7 


Consider the discrete-time unity-feedback control system (with sampling period T = 1 
sec) whose open-loop pulse transfer function is given by 


. K(0.3679z + 0.2642) 
GG) 72 - 0369yz - 1) 


Determine the range of gain K for stability by use of the Jury stability test. 
The closed-loop pulse transfer function becomes 


C(z) K(0.3679z + 0.2642) 
R(z) z? + (0.3679K — 1.3679)z + 0.3679 + 0.2642K 


Thus, the characteristic equation for the system is 


P(z) = z? + (0.3679K — 1.3679)z + 0.3679 + 0.2642K = 0 


Since this is a second-order system, the Jury stability conditions may be written as 
follows: 


1. las] < do 
2. P(1) >0 
3. P(-1) » 0, n = 2 = even 


We shall now apply the first condition for stability. Since a; = 0.3679 + 0.2642K 
and ae = 1, the first condition for stability becomes 


(0.3679 + 0.2642K| < 1 
or 
2.3925 > K > —5.1775 (4-6) 
The second condition for stability becomes 
P(1) = 1 + (0.3679K — 1.3679) + 0.3679 + 0.2642K = 0.6321K > 0 
which gives 
K>0 (4-7) 
The third condition for stability gives 
P(-1) = 1 — (0.3679K — 1.3679) + 0.3679 + 0.2642K = 2.7358 — 0.1037K > 0 
which yields 
26.382 > K (4-8) 
For stability, gain constant K must satisfy inequalities (4—6), (4-7), and (4-8). Hence, 
2.3925 > K >0 
The range of gain constant K for stability is between 0 and 2.3925. 
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If gain K is set equal to 2.3925, then the system becomes critically stable (meaning 
that sustained oscillations exist at the output). The frequency of the sustained oscilla- 
tions can be determined if 2.3925 is substituted for K in the characteristic equation and 
the resulting equation is investigated. With K — 2.3925, the characteristic equation 
becomes 


z? — 0.4877z +1=0 


The characteristic roots are at z = 0.2439 + j0.9698. Noting that the sampling period 
T is equal to 1 sec, from Equation (4-2) we have 


29s , 27 , uuu 0.9698 _ 
wy = 50 [2 = Sp (2 = tan ggg = 1.3244 radísec 


The frequency of the sustained oscillations is 1.3244 rad/sec. 


Stability Analysis by Use of the Bilinear Transformation and Routh Stability 
Criterion. Another method frequently used in the stability analysis of discrete- 
time control systems is to use the bilinear transformation coupled with the Routh 
stability criterion. The method requires transformation from the z plane to another 
complex plane, the w plane. Those who are familiar with the Routh-Hurwitz 
stability criterion will find the method simple and straightforward. However, the 
amount of computation required is much more than that required in the Jury stability 
criterion. 

The bilinear transformation defined by 


| wtl1 
z= w-1 
which, when solved for w, gives 
w= z+1 
z-1 


maps the inside of the unit circle in the z plane into the left half of the w plane. This 
can be seen as follows. Let the real part of w be called ø and the imaginary part w, 
so that 


w=art jw 


Since the inside of the unit circle in the z plane is 


zl- [224 -|4eH <1 
w-1 a+jw-1 
or 
+17 +a? 
we get 
(c + 1P + w&’<(o- 1% +o 
which yields 


a «0 
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Thus, the inside of the unit circle in the z plane (|z| < 1) corresponds to the left half 
of the w plane. The unit circle in the z plane is mapped into the imaginary axis in 
the w plane, and the outside of the unit circle in the z plane is mapped into the right 
half of the w plane. (It is pointed out that, although the w plane is similar to the s 
plane in that it maps the inside of the unit circle to the left half-plane, it is by no means 
quantitatively equivalent to the s plane. Therefore, estimating the relative stability 
of the system from the pole locations in the w plane is difficult.) 

In the stability analysis using the bilinear transformation coupled with the 
Routh stability criterion, we first substitute (w + 1)/(w — 1) for z in the character- 
istic equation 


P(z) = az" + a,z"!+-+--+4,,2 +a, =0 


as follows: 


w +1\" w+1\"" w+] 
+... + _— + = 
a( =) + a(244) a, ye a, — 0 


Then, clearing the fractions by multiplying both sides of this last equation by 
(w — 1)", we obtain 


Q(w) = bow" + bw" +--+ + bw +b, =0 


Once we transform P(z) = 0 into Q(w) = 0, it is possible to apply the Routh 
stability criterion in the same manner as in continuous-time systems. 

It is noted that the bilinear transformation coupled with the Routh stability 
criterion will indicate exactly how many roots of the characteristic equation lie in the 
right half of the w plane and how many lie on the imaginary axis. However, such 
information about the exact number of unstable poles is usually not needed in control 
systems design, because unstable or critically stable control systems are not desired. 
As mentioned earlier, the amount of computation required in this approach is much 
more than that required in the Jury stability test. Therefore, we shall not go any 
further on this subject here. We refer the reader to Problem A-4-3, where the 
present method is used for stability analysis. 


A Few Comments on the Stability of Closed-Loop Control Systems 


1. If we are interested in the effect of a system parameter on the stability of a 
closed-loop control system, a root-locus diagram may prove to be useful. 
MATLAB may be used to compute and plot a root-locus diagram. 

2. It is noted that in testing the stability of a characteristic equation it may be 
simpler, in some cases, to find the roots of the characteristic equation directly 
by use of MATLAB. 


3. It is important to point out that stability has nothing to do with the system's 
ability to follow a particular input. The error signal in a closed-loop control 
system may increase without bound, even if the system is stable. (Refer to 
Section 4—4 for a discussion of error constants.) 


Y" 
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4-4 TRANSIENT AND STEADY-STATE RESPONSE ANALYSIS 


Absolute stability is a basic requirement of all control systems. In addition, good 
relative stability and steady-state accuracy are also required of any control system, 
whether continuous time or discrete time. 

In this section we shall discuss transient response and steady-state response 
characteristics of closed-loop control systems. The transient response refers to that 
portion of the response due to the closed-loop poles of the system, and the steady- 
state response refers to that portion of the response due to the poles of the input 
or forcing function. 

Discrete-time control systems are very frequently analyzed with *'standard" 
inputs such as step inputs, ramp inputs, or sinusoidal inputs. This is because the 
system's response to any arbitrary input may be estimated from its response to such 
standard inputs. In this section, we shall consider the response of the discrete-time 
control system to time-domain inputs such as step inputs. 


Transient Response Specifications. In many practical cases, the desired per- 
formance characteristics of control systems, whether they are continuous time or 
discrete time, are specified in terms of time-domain quantities. This is because 
systems with energy storage cannot respond instantaneously and will always exhibit 
transient response whenever they are subjected to inputs or disturbances. 

Frequently, the performance characteristics of a control system are specified 
in terms of the transient response to a unit-step input, since the unit-step input is 
easy to generate and is sufficiently drastic to provide useful information on both the 
transient response and the steady-state response characteristics of the system. 

The transient response of a system to a unit-step input depends on the initial 
conditions. For convenience in comparing transient responses of various systems, it 
is a common practice to use the standard initial condition: the system is at rest 
initially and the output and all its time-derivatives are zero. The response character- 
istics can then be easily compared. 

The transient response of a practical control system, where the output signal 
is continuous time, often exhibits damped oscillations before reaching the steady 
state. (This is true for the majority of discrete-time or digital control systems because 
the plants to be controlled are in most cases continuous time and, therefore, the 
output signals are continuous time.) 

Consider, for example, the digital control system shown in Figure 4-14. The 


c(kT) 
———3À- 


Figure 4-14 A digital control system. 
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c (t) 


(a) 


Figure 4-15 (a) Unit-step response of 
the system shown in Figure 4-14; 

(b) discrete-time output in the unit-step 
ib) response. 


output c(t) of such a system to a unit-step input may exhibit damped oscillations as 
shown in Figure 4—15(a). Figure 4-15(b) shows the discrete-time output c(kT). 
Just as in the case of continuous-time control systems, the transient response 
of a digital control system may be characterized not only by the damping ratio and 
damped natural frequency, but also by the rise time, maximum overshoot, settling 
time, and so forth, in response to a step input. In fact, in specifying such transient 
response characteristics, it is common to specify the following quantities: 


TRANSIENT RESPONSE SPECIFICATIONS 


1. Delay time t, 

2. Rise time f, 

3. Peak time t, 

4. Maximum overshoot M, 
5. Settling time f, 


The aforementioned transient response specifications in the unit-step response 
are defined in what follows and are shown graphically in Figure 4-16. 


1. Delay time t4. The delay time is the time required for the response to reach half 
the final value the very first time. 
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2. 


cit) 


Allowable tolerance 


Figure 4-16 Unit-step response curve showing transient response specifications t4, 
t, tj, Mp, and t. 


Rise time t,. The rise time is the time required for the response to rise from 10% 
to 90%, or 5% to 95%, or 0% to 100% of its final value, depending on the 
situation. For underdamped second-order systems, the 0% to 100% rise time 
is commonly used. For overdamped systems and systems with transportation 
lags, the 10% to 90% rise time is commonly used. 

Peak time t,. The peak time is the time required for the response to reach the 
first peak of the overshoot. 

Maximum overshoot M,. The maximum overshoot is the maximum peak value 
of the response curve measured from unity. If the final steady-state value of 
the response differs from unity, then it is common to use the maximum percent 
overshoot. It is defined by the relation 


c(t) — c(») 
c(») 
The amount of the maximum (percent) overshoot directly indicates the relative 

stability of the system. 


Settling time t,. The settling time is the time required for the response curve 
to reach and stay within a range about the final value of a size specified as an 
absolute percentage of the final value, usually 2%. The settling time is related 
to the largest time constant of the control system. 


Maximum percent overshoot = x 100% 


The time-domain specifications just given are quite important since most 


control systems are time-domain systems; that is, they must exhibit acceptable time 
responses. (This means that the control system being designed must be modified 
until the transient response is satisfactory.) 


Not all the specifications we have just defined necessarily apply to any given 
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case. For example, for an overdamped system, the peak time and maximum over- 
shoot terms do not apply. On the other hand, other specifications may be involved: 
for systems that yield steady-state errors for step inputs, the error must be kept 
within a specified percentage level. (Detailed discussions of steady-state errors will 
be given later in this section.) 

Let us assume that the sampling theorem is satisfied and no frequency folding 
occurs. The nature of the transient response of a discrete-time control system to a 
given input depends on the actual locations of the closed-loop poles and zeros in the 
z plane. Consider the discrete-time control system defined by 


C(z) _ boz" + biz"! +... + b, 


R(z) oz" + az"! +.. +a, (4-9) 


where R(z) is the z transform of the input and C(z) is the z transform of the output. 
The transient response of such a system to the Kronecker delta input, step input, 
ramp input, and so on, can be obtained easily by use of MATLAB. See, for example, 
Example 4-8. 


Example 4-8 
Consider the discrete-time control system defined by 


C(z) _ __0.4673z — 0.3393 
R(z) z?- 1.5327z + 0.6607 
Obtain the unit-step response of this system. 


A MATLAB program for obtaining the unit-step response is shown in MATLAB 
Program 4-1. The resulting plot of c(k) versus k is shown in Figure 4-17. 


(4-10) 


MATLAB Program 4-1 


9o ---------- Unit-step response ---------- 


num = [0 0.4673 -0.3393]; 
den = [1 -1.5327 0.6607]; 
r = ones(1,41); 

v=[0 40 0 1.6]; 

axis(v); 

k = 0: 40; 

c = filterínum,den,r); 
plot(k,c,'o') 

grid 

title('Unit-Step Response!) 
xlabel('k') 

ylabel(‘c(k)') 


Steady-State Error Analysis. An important feature associated with transient 
response is steady-state error. The steady-state performance of a stable control 
system is generally judged by the steady-state error due to step, ramp, and acceler- 
ation inputs. In what follows we shall investigate a type of steady-state error that is 
caused by the inability of a system to follow particular types of inputs. (It should be 
noted that, besides this type of steady-state error, there are errors that can be 
attributed to other causes, such as imperfections in system components, static 
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Unit-Step Response 


00.0.0.0.00000000000000 


o : go? 
900099? | 


c(k) 


0 5 10 15 20 25 30 35 40 
k 
Figure 4-17 Unit-step response of the system defined by Equation (4-10). 


friction, backlash, or deterioration or aging of components. In this section, however, 
we shall not discuss steady-state error due to such causes.) 

Any physical control system inherently suffers steady-state error in response 
to certain types of inputs. That is, a system may have no steady-state error with step 
inputs, but the same system may exhibit nonzero steady-state error in response to 
ramp inputs. Whether or nota given system will exhibit steady-state error in response 
to a given type of input depends on the type of open-loop transfer function of the 
system. 

Consider the continuous-time control system whose open-loop transfer func- 
tion G(s)H(s) is given by 
K(T,s + (Tos + 1)--+ (Tas + 1) 
shs + (5s +1) (35s +1) 


The term s" in the denominator represents a pole of multiplicity N at the origin. It 
is customary to classify the system according to the number of integrators in the 
open-loop transfer function. 

A system is said to be of type 0, type 1, type 2,..., if N=0, N=1, 
N =2,..., respectively. Type 0 systems will exhibit finite steady-state errors in 
response to step inputs and infinite errors in response to ramp and higher-order 
inputs. Type 1 systems will exhibit no steady-state error in response to step inputs, 
finite steady-state errors in response to ramp inputs, and infinite steady-state errors 
in response to acceleration and higher-order inputs. As the type number is increased, 
accuracy is improved. However, increasing the type number aggravates the stability 
problem. A compromise between steady-state accuracy and relative stability (tran- 
sient response characteristics) is always necessary. 

The concepts of static error constants can be extended to the discrete-time 
control system, as discussed in what follows. 


G(s)H(s) = 
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Discrete-time control systems can be classified according to the number of 
open-loop poles at z = 1. (An open-loop pole at z = 1 corresponds to an integrator 
in the loop.) Suppose the open-loop pulse transfer function is given by the equation 
. 1 Bi) 

(z - 1)" A(z) 

where B(z)/A(z) contains neither a pole nor a zero at z = 1. Then the system can 
be classified as a type 0 system, a type 1 system, or a type 2 system according to 
whether N = 0, N = 1, or N = 2, respectively. The system type specifies the steady- 
state characteristics or steady-state accuracy. 

The physical meaning of the static error constants for discrete-time control 
systems is the same as that for continuous-time control systems, except that the 
former transmit information only at the sampling instants. 

Consider the discrete-time control system shown in Figure 4-18. We assume 
that the system is stable so that the final value theorem can be applied to find the 
steady-state values. From the diagram we have the actuating error 


e(t) = r(t) — b(t) 


We shall consider the steady-state actuating error at the sampling instants. Note that 
from the final value theorem we have 


lim e(kT) = lim (1 — z)£(z)] (4-11) 


For the system shown in Figure 4-18, define 


Open-loop pulse transfer function — 


a 


Giz) =(1- ez : 


and 
GH(z) = (1 - zz | See) 2 
Then we have 
C(z2 G(z) 
R(z) 1+ GH(z) 


and 


E(z) = R(z) - B(z) = R(z) - GH(z)E(z) 
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or 


E(z) = (4-12) 


1 
1+ GH@*®) 
By substituting Equation (4-12) into Equation (4-11), we obtain 


es = lim la -= xmi, (4-13) 


zl 


As in the case of the continuous-time control system, we consider three types of 
inputs: unit-step, unit-ramp, and unit-acceleration inputs. 


Static Position Error Constant. For a unit-step input r(t) = 1(t), we have 


1 
R(z) = jer 


By substituting this last equation into Equation (4-13) the steady-state actuating 
error in response to a unit-step input can be obtained as follows: 


"E im | - Oams = lim ——ÀL—— 
5 zl 1+ GH(z) 1- z zıl + GH(z) 


We define the static position error constant K, as follows: 
K, = lim GH(z) (4-14) 
zl 


Then the steady-state actuating error in response to a unit-step input can be obtained 
from the equation 
1 


e =F, 


(4-15) 


The steady-state actuating error in response to a unit-step input becomes zero if 


K, = œ, which requires that GH(z) have at least one pole at z = 1. 


Static Velocity Error Constant. For a unit-ramp input r(t) = t1(t), we have 


R@) = qr 


By substituting this last equation into Equation (4-13), we have 


= lim (1 - z)— E | = lim- 
s = z ü-r-gGHz)ü-zy| 2d —-z)GH®) 


Now we define the static velocity error constant K, as follows: 


MN z )6HG) 


K, = (4-16) 


zl 
Then the steady-state actuating error in response to a unit-ramp input can be 
given by 
es = K (4-17) 
If K, = v, then the steady-state actuating error in response to a unit-ramp input is 
zero. This requires GH(z) to possess a double pole at z = 1. 
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Static Acceleration Error Constant. For a unit acceleration input r(t)= 
1i? 1(r), we have 
T*(1*z)z! 
DE EE 
By substituting this last equation into Equation (4-13), we obtain 
1 T?(1 + | T? 
= — z71)—_~—____ _ i _ * o. = —————— 
es = lim la 7 TS GHG 20-2 | g z GHQ) 
We define the static acceleration error constant K, as follows: 


— 5 71\2 
K, = lim& z lY GH(z) 


lim Ti (4-18) 
Then the steady-state actuating error becomes 
e=} (4-19) 
SS K, 


The steady-state actuating error in response to a unit-acceleration input becomes 
zero if K, = v. This requires GH(z) to possess a triple pole at z = 1. 

Equations (4-15), (4-17), and (4-19) give the expressions for steady-state 
actuating errors of the discrete-time control system shown in Figure 4-18 at the 
sampling instants for a unit-step, unit-ramp, and unit-acceleration input, respec- 
tively. 


Summary. It is important to emphasize that the actuating error is the differ- 
ence between the reference input and the feedback signal, not the difference be- 
tween the reference input and the output. From the foregoing analysis we see that 
a type 0 system will exhibit a constant steady-state actuating error in response to a 
step input and an infinite actuating error in response to ramp, acceleration, or 
higher-order inputs. A type 1 system will exhibit a zero steady-state actuating error 
in response to a step input, a constant steady-state error in response to a ramp input, 
and an infinite steady-state actuating error in response to acceleration or higher- 
order inputs. 


TABLE 4-4 SYSTEM TYPES AND THE CORRESPONDING 
STEADY-STATE ERRORS IN RESPONSE TO STEP, RAMP, AND 
ACCELERATION INPUTS FOR THE DISCRETE-TIME CONTROL 
SYSTEM SHOWN IN FIGURE 4-18 


Steady-state errors in response to 


Acceleration 
input 
r(t) =30 


Step input 
r(t) 21 


Ramp input 


r(t) 7 t 


Type 0 system 


Type 1 system 


Type 2 system 
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Table 4—4 lists system types and the corresponding steady-state errors in 
response to step, ramp, and acceleration inputs for the discrete-time control system 
of the configuration shown in Figure 4-18. 

The steady-state error analysis just presented applies to the closed-loop 
discrete-time control system shown in Figure 4-18. For a different closed-loop 
configuration, it is noted that if the closed-loop discrete-time control system has a 
closed-loop pulse transfer function, then the static error constants can be determined 
by an analysis similar to the one just presented. Table 4—5 lists the static error 
constants for typical closed-loop configurations of discrete-time control systems. If 
the closed-loop discrete-time control system does not have a closed-loop pulse 
transfer function, however, the static error constants cannot be defined, because the 
input signal cannot be separated from the system dynamics. 

It is important to note that the terms "position error," “velocity error," and 
*acceleration error" mean steady-state deviations in the output position. A finite 
velocity error implies that after transients have died out the input and output move 
at the same velocity, but have a finite position difference. 


TABLE 4-5 STATIC ERROR CONSTANTS FOR TYPICAL CLOSED-LOOP 
CONFIGURATIONS OF DISCRETE-TIME CONTROL SYSTEMS 


Closed-loop configuration Values of Kp, Ky, and Kg 


K, = lim GHG) 


Lu X zz )GH() 
K, = lim T Z 


z=>1 


— 2712 
K, = lim (ZZZS E O 


zl T? 


Kp = lim G(z)H(z) 


— 54-71 
K, = lim M z 1G(z)H(z) 


z1 T 
=y; (1—z ?G(z)H(z) 
Ka lim T? 


Kp = lim Gi(ZzZ)HGz) 


Lau d= 27)Gi@)HG Az) 
Ky = lim T 


qi (1—z !YG;()HG»x() 
Ka = lim T? 


Kp = lim G1(z)G2)H@) 


a 0-276 ,2Z)G2Z)HE@ 
Ky = lim T 


ou (0 —z Y G()Gx2)H 
Ka = lim T? 
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Response to Disturbances. In examining transient response characteristics 
and steady-state errors, it is important to note that the effects of disturbances, in 
addition to those of reference inputs, must be explored. 

For the system shown in Figure 4—19(a), let us assume that the reference input 
is zero, or R(z) = 0, but the system is subjected to disturbance N(z). For this case 
the system block diagram can be redrawn as shown in Figure 4-19(b). Then the 
response C(z) to disturbance N(z) can be found from the closed-loop pulse transfer 
function 


€). CE) 
N(z) 1+ Gp(z)G(z) 


If |Gp(z)G(z)| >> 1, then we find 


(a) 


(bi 


Figure4-19 (a) Digital closed-loop control system subjected to reference input and 
disturbance input; (b) modified block diagram where the disturbance input is con- 
sidered the input to the system. 


"E 
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Since the system error is 
E(z) = R(z) - C(z) = -C(z) 
we find the error E(z) due to the disturbance N(z) to be 


1 
E(z) = ————N(z 
(2) = - gigs NG) 
Thus, the larger the gain of Gp(z) is, the smaller the error E(z). If Gp(z) includes 
an integrator [which means that Gp(z) has a pole at z = 1], then the steady-state 
error due to a constant disturbance is zero. This may be seen as follows. Since for 
a constant disturbance of magnitude N we have 


N 
N(z) = 1 — zg) 
if Gp(z) involves a pole at z = 1, then it may be written as 
m Gp(z) m Gp(z)z^! 
Gol) ey T 4-277 


where Gp(z) does not involve any zeros at z — 1. Then the steady-state error can 
be given by 


—N 
iala oso] - ta [e - 2-9 5 
: = N 1 . (=2)\N 
E = P 2e M. LES rr NE = 
lim |a € i = 2 zia Are Gp(z)z^? 

If a linear system is subjected to both the reference input and a disturbance 
input, then the resulting error is the sum of the errors due to the reference input and 
the disturbance input. The total error must be kept within acceptable limits. 

Note that the point where the disturbance enters the system is very important 
in adjusting the gain of Gp(z)G(z). For example, consider the system shown in 
Figure 4-20(a). The closed-loop pulse transfer function for the disturbance is 


Cz) — E(z). 1 
N(z) N(z) 1+ Go(z)G(z) 
To minimize the effects of disturbance N(z) on the system error E(z), the gain of 


Gp(z)G(z) must be made as large as possible. However, for the system shown in 
Figure 4—20(b), the closed-loop pulse transfer function for the disturbance is 
Cz) EG) | Go@)G(2) 
N(z) N(z) 1+ Gp(z)G(z) 
and to minimize the effects of disturbance N(z) on the system error E(z), the gain 
of Gp(z)G(z) must be made as small as possible. 

Therefore, it is advantageous to obtain the expression for E(z)/N(z) before 
concluding whether the gain of Gp(z)G(z) should be large or small to minimize the 
error due to disturbances. It is important to remember, however, that the magnitude 
of the gain cannot be determined solely from the disturbance considerations. It must 
be determined by considering the responses to both reference and disturbance 
inputs. If the frequency regions for the reference input and disturbance input are 
sufficiently apart, a suitable filter may be inserted in the system. If the frequency 


ess 
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Niz} 


N(z) 


(b) 


Figure4-20 (a) Digital closed-loop control system subjected to reference input and 
disturbance input; (b) digital closed-loop control system where the disturbance 
enters the feedback loop. 


regions overlap, then modification of the block diagram configuration may become 
necessary to get acceptable responses to both reference and disturbance inputs. 


4-5 DESIGN BASED ON THE ROOT-LOCUS METHOD 


As discussed in Section 4—4, the relative stability of the discrete-time control system 
may be investigated with respect to the unit circle in the z plane. For example, if the 
closed-loop poles are complex conjugates and lie inside the unit circle, the unit-step 
response will be oscillatory. 
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In addition to the transient response characteristics of a given system, it is often 
necessary to investigate the effects of the system gain and/or sampling period on the 
absolute and relative stability of the closed-loop system. For such purposes the 
root-locus method proves to be very useful. 

The root-locus method developed for continuous-time systems can be extended 
to discrete-time systems without modifications, except that the stability boundary is 
changed from the jw axis in the s plane to the unit circle in the z plane. The reason 
the root-locus method can be extended to discrete-time systems is that the char- 
acteristic equation for the discrete-time system is of the same form as that for 
the continuous-time system in the s plane. For example, for the system shown in 
Figure 4-21 the characteristic equation is 


1+ G(z)H(z) = 0 


which is of exactly the same form as the equation for root-locus analysis in the s 
plane. However, the pole locations for closed-loop systems in the z plane must be 
interpreted differently from those in the s plane. 

In this section we shall demonstrate the application of the root-locus method 
to the design of discrete-time or digital control systems. 

Computer programs for calculating and tracing root loci are available for most 
computer systems. In particular, MATLAB provides a convenient means to plot root 
loci for both continuous-time and discrete-time closed-loop systems. Exact plotting 
of the root loci can be done on the computer and, therefore, we may not need 
graphical plotting procedures. However, skill in plotting root loci is an advantage, 
since it will enable the control engineer to make quick graphical plots for given 
problems to speed up preliminary stages of system design. In fact, the experienced 
control engineer frequently uses the root-locus approach to a preliminary design to 
locate the dominant closed-loop poles at desired positions in the z plane and then 
uses a digital simulation to improve the closed-loop performance. 


Angle and Magnitude Conditions. In many linear time-invariant discrete-time 
control systems, the characteristic equation may have either of the following two 
forms: 


1+ G(z)H(z) = 0 
and 
1+ GH(z) =0 


Figure 4-21 Closed-loop control 
system. 
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To combine these two forms into one, let us define the characteristic equation as 
1+ F(z) =0 (4-20) 
where 
F(z) = G(z)H(z) or F(z) = GH(z) 


Note that F(z) is the open-loop pulse transfer function. The characteristic equation 
given by Equation (4-20) can then be written as 


F(z) =-1 


Since F(z) is a complex quantity, this last equation can be split into two equations 
by equating first the angles and then the magnitudes of the two sides to obtain 


ANGLE CONDITION: 


/F(z) = +180°(2k + 1) k =0,1,2,... 


MAGNITUDE CONDITION: 
|F(z)| = 1 


The values of z that fulfill both the angle and the magnitude conditions are the roots 
of the characteristic equation, or the closed-loop poles. 

A plot of the points in the complex plane satisfying the angle condition alone 
is the root locus. The roots of the characteristic equation (the closed-loop poles) 
corresponding to a given value of the gain can be located on the root loci by use of 
the magnitude condition. The details of applying the angle and magnitude conditions 
to obtain the closed-loop poles are presented in the following. 


General Procedure for Constructing Root Loci. For a complicated system with 
many open-loop poles and zeros, constructing a root-locus plot may seem compli- 
cated, but actually it is not difficult if the established rules for constructing root loci 
are applied. 

By locating particular points and asymptotes and by computing angles of 
departure from complex poles and angles of arrival at complex zeros, it is possible 
to construct root loci without difficulty. Note that while root loci may be conveniently 
drawn with a digital computer, if manual construction of the root locus plot is 
attempted, we essentially proceed on a trial-and-error basis. But the number of trials 
required can be greatly reduced if the established rules are used. 

Because the open-loop conjugate complex poles and conjugate complex zeros, 
if any, are always located symmetrically about the real axis, the root loci are always 
symmetric with respect to the real axis. Hence, we need only construct the upper 
half of the root loci and draw the mirror image of the upper half in the lower half 
of the z plane. Remember that the angles of the complex quantities originating from 
the open-loop poles and open-loop zeros and drawn to a test point z are measured 
in the counterclockwise direction. We shall now present the general rules and 
procedures for constructing root loci. 
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General Rules for Constructing Root Loci 
1. Obtain the characteristic equation 
1+ F(z2)-0 


and then rearrange this equation so that the parameter of interest, such as gain K, 
appears as the multiplying factor in the form 


K(z + z)(z + z3) (2 + Zm) _ 
(z + pil(z + pa) (z + Pa) 


In the present discussion, we assume that the parameter of interest is gain K, where 
K > 0. From the factored form of the open-loop pulse transfer function, locate the 
open-loop poles and zeros in the z plane. [Note that if F(z) ^ G(z)H(z) then the 
open-loop zeros are zeros of G(z)H(z), while the closed-loop zeros consist of the 
zeros of G(z) and the poles of H(z).] 

2. Find the starting points and terminating points of the root loci. Find also 
the number of separate branches of the root loci. The points on the root loci 
corresponding to K = 0 are open-loop poles and those corresponding to K = œ are 
open-loop zeros. Hence, as K is increased from zero to infinity, a root locus starts 
from an open-loop pole and terminates at a finite open-loop zero or an open-loop 
zero at infinity. This means that a root-locus plot will have just as many branches 
as there are roots of the characteristic equation. [If the zeros at infinity are included 
in the count, F(z) has the same number of zeros as poles.] 

If the number n of closed-loop poles is the same as the number of open-loop 
poles, then the number of individual root locus branches terminating at finite 
open-loop zeros is equal to the number m of the open-loop zeros. The remaining 
n — m branches terminate at infinity (at n — m implicit zeros at infinity) along 
asymptotes. 

3. Determine the root loci on the real axis. Root loci on the real axis are 
determined by open-loop poles and zeros lying on it. The conjugate complex poles 
and zeros of the open-loop pulse transfer function have no effect on the location of 
the root loci on the real axis because the angle contribution of a pair of conjugate 
complex poles or zeros is 360° on the real axis. Each portion of the root locus on 
the real axis extends over a range from a pole or zero to another pole or zero. 

In constructing the root loci on the real axis, choose a test point on it. If the 
total number of real poles and real zeros to the right of this test point is odd, then 
this point lies on a root locus. The root locus and its complement form alternate 
segments along the real axis. 

4. Determine the asymptotes of the root loci. If the test point z is located far 
from the origin, then the angles of all the complex quantities may be considered the 
same. One open-loop zero and one open-loop pole then each cancel the effects of 
the other. 

Therefore, the root loci for very large values of z must be asymptotic to straight 
lines whose angles are given as follows: 


+180°(2N + 1) 
n-m : 


1+ 0 


Angle of asymptote = N =0,1,2,... 
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where 


n = number of finite poles of F(z) 


m = number of finite zeros of F(z) 


Here, N = Ocorresponds to the asymptote with the smallest angle with the real axis. 
Although N assumes an infinite number of values, the angle repeats itself, as N is 
increased, and the number of distinct asymptotes is n — m. 
All the asymptotes intersect on the real axis. The point at which they do so is 

obtained as follows. Since 
K[z" + (zi + zi t c + z4)z" | b e + Ziz Zm] 

z" + (pit pot "m tp)" + eee + ppccpa 
E K 

z"™ + [(pi + pa +6 + Pa) (21t zy + ee + Zm) + 


F(z) = 


for a large value of z this last equation may be approximated as follows: 
K 


[z « pet tpa Genet oot n) Um 
n-m 


F(z) = 


If the abscissa of the intersection of the asymptotes and the real axis is denoted 
by —o,, then 


(mt picto + pu) — (21t z occ) 
n-m 


=T, = (4-21) 
Because all the complex poles and zeros occur in conjugate pairs, —o, given by 
Equation (4-21) is always a real quantity. 

Once the intersection of the asymptotes and the real axis is found, the asymp- 
totes can be readily drawn in the complex z plane. 

5. Find the breakaway and break-in points. Because of the conjugate symme- 
try of the root loci, the breakaway points and break-in points either lie on the real 
axis or occur in conjugate complex pairs. 

If a root locus lies between two adjacent open-loop poles on the real axis, then 
there exists at least one breakaway point between the two poles. Similarly, if the root 
locus lies between two adjacent zeros (one zero may be located at —%) on the real 
axis, then there always exists at least one break-in point between the two zeros. 

If the root locus lies between an open-loop pole and a zero (finite or infinite) 
on the real axis, then there may exist no breakaway or break-in points or there may 
exist both breakaway and break-in points. 

If the characteristic equation 


1+ F(z) =0 
is written as 


KB(z) _ 


1+ Gy 
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where KB(z)/A(z) ^ F(z), then 
_A(z) 
B(z) 


and the breakaway and break-in points (which correspond to multiple roots) can be 
determined from the roots of 
dK X A'(z)B(z) — A(z)B'(z) -0 


dz B'(z) 
where the prime indicates differentiation with respect to z. (See Problem A—4—5 for 
a proof.) 

If the value of K corresponding to a root z = zo of dK/dz = Ois positive, point 
Z = 2, is an actual breakaway or break-in point. Since K is assumed to be non- 
negative, if the value of K thus obtained is negative, then point z = zo is neither a 
breakaway nor a break-in point. 

Note that this approach can be used when there are complex poles and/or 
complex zeros. 

6. Determine the angle of departure (or angle of arrival) of the root loci from 
the complex poles (or at the complex zeros). To sketch the root loci with reasonable 
accuracy, we must find the direction of the root loci near the complex poles and 
zeros. The angle of departure (or angle of arrival) of the root locus from a complex 
pole (or at a complex zero) can be found by subtracting from 180? the sum of all the 
angles of lines (complex quantities) from all other poles and zeros to the complex 
pole (or complex zero) in question, with appropriate signs included. The angle of 
departure is shown in Figure 4-22. 

7. Find the points where the root loci cross the imaginary axis. The points 
where the root loci intersect the imaginary axis can be found by setting z — jvin the 
characteristic equation (which involves undetermined gain K), equating both the real 
part and the imaginary part to zero, and solving for v and K. The values of v and 


K= 


(4-22) 


(4-23) 


z plane 


Angle of departure = 
< 180° - (6, +0,- 4) 


Figure 4-22 Diagram showing angle of departure. 
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K thus found give the location at which the root loci cross the imaginary axis and 
the value of the corresponding gain K, respectively. 

8. Any point on the root loci is a possible closed-loop pole. A particular point 
will be a closed-loop pole when the value of gain K satisfies the magnitude condition. 
Conversely, the magnitude condition enables us to determine the value of gain K 
at any specific root location on the locus. The magnitude condition is 


|F(z)| = 1 
or 


(z *tz)ztz)y:tz)| 1 (4-24) 
(z + p(z + pr) (tp)! K 
If gain K of the open-loop pulse transfer function is given in the problem, then 
by applying the magnitude condition, Equation (4-24), it is possible to locate the 
closed-loop poles for a given K on each branch of the root loci by a trial-and-error 
method. 


Cancellation of Poles of G(z) With Zeros of H(z). It is important to note that 
if F(z) = G(z)H(z) and the denominator of G(z) and the numerator of H(z) 
involve common factors then the corresponding open-loop poles and zeros will 
cancel each other, reducing the degree of the characteristic equation by one or more. 
The root locus plot of G(z)H(z) will not show all the roots of the characteristic 
equation, but only the roots of the reduced equation. 

To obtain the complete set of closed-loop poles, we must add the canceled pole 
or poles of G(z)H(z) to those closed-loop poles obtained from the root locus plot 
of G(z)H(z). The important thing to remember is that a canceled pole of G(z)H(z) 
is a closed-loop pole of the system. 

As an example, consider the case where G(z) and H(z) of the system shown 
in Figure 4-21 are given by 


ztc 
CO) GF ae Fb) 
and 
+ 

Be) ; + d 
Then, clearly, the pole z = —a of G(z) and the zero z = —a of H(z) cancel each 
other, resulting in 

z+c z+a z+c 


GOHG = Grae t b)z+ d” EFE) 


However, the closed-loop pulse transfer function of the system is 


C2). GG) o_O MEH) 
R(z) 1+ G(z)H(z) (z-*a)(z-b)yz-d)-z-*c] 
and we see that z = —a, the canceled pole of G(z)H(z), is a closed-loop pole of the 


closed-loop system. 
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Note, however, that if pole-zero cancellation occurs in the feed-forward pulse 
transfer function, then the same pole-zero cancellation occurs in the closed-loop 
pulse transfer function. Consider again the system shown in Figure 4—21, where we 
assume 


G(z) = Gp(z)Gi(z), H(z) =1 
Suppose pole-zero cancellation occurs in Gp(z)G,(z). For example, suppose 


ztb ztd ztd 


COG eae Pee) (Gaz PS 


Then the closed-loop pulse transfer function becomes 


C(z . Go(z)G\(z) _ (z + b)(z + d) 
R(z) 1+ Gp(z)Gi(z) (z-b)(z-a)yz-c)-z- d] 
ztd 


"(4a *c)*z4d 


Because of the pole-zero cancellation, the third-order system becomes one of second 
order. 

It is important to summarize that the effect of pole-zero cancellation in G(z) 
and H(z) is different from that of pole-zero cancellation in the feed-forward pulse 
transfer function (such as pole-zero cancellation in the digital controller and the 
plant). In the former, the canceled pole is still a pole of the closed-loop system, 
whereas in the latter the canceled pole does not appear as a pole of the closed-loop 
system (in the latter the order of the system is reduced by the number of canceled 
poles). 


Root-Locus Diagrams of Digital Control Systems. In what follows we shall 
investigate the effects of gain K and sampling period T on the relative stability of 
the closed-loop control system. Consider the system shown in Figure 4-23. Assume 
that the digital controller is of the integral type, or that 


z 
z=] 


K 
Goz) = 72777 =K 


Let us draw root locus diagrams for the system for three values of the sampling period 
T: 0.5 sec, 1 sec, and 2 sec. Let us also determine the critical value of K for each 
case. And finally let us locate the closed-loop poles corresponding to K = 2 for each 
of the three cases. 


Integral 
controller 


Figure 4-23 Digital control system. 
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We shall first obtain the z transform of G,(s)G, (s): 


zias) =z = ; | 


s+1 
— — 71) 1 
ü PER 
1 1 
= — -lys —— 
v rz} Hl 
-4 z 2 z | 
z 2-1 z-eft 
Lee 
z—et 


The feedforward pulse transfer function becomes 


Kz l1-e7 
G(z) = G»(2) 216,G)6,()] = —4 7—, (4-25) 
The characteristic equation is 
1+ G(z) =0 
or 
Kz(0-e7?) _ 
oa (z -— 1)(z-e77) 9 ae) 
1. Sampling period T = 0.5 sec: For this case, Equation (4-25) becomes 
Gq) = 0.3935Kz 


(z — 1)(z — 0.6065) 
Notice that G(z) has poles at z = 1 and z = 0.6065 and a zero at z = 0. 

To draw a root locus diagram, we first locate the poles and zero in the z plane 
and then find the breakaway point and break-in point. Notice that this open-loop 
pulse transfer function with two poles and one zero results in a circular root locus 
centered at the zero. The breakaway point and break-in point are determined by 
writing the characteristic equation in the form of Equation (4-22), 


(z — 1)(z — 0.6065) 
0.3935z 


and differentiating K with respect to z and equating the result to zero: 
dK z? — 0.6065 _ 


K=- (4-27) 


‘a 039352 ^9 
Hence, 

z? = 0.6065 
or 


z = 0.7788 and z = —0.7788 
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Notice that substitution of 0.7788 for z in Equation (4—27) yields K — 0.1244, while 
letting z — —0.7788 yields K — 8.041. Since both K values are positive, z — 0.7788 
is the actual breakaway point and z — —0.7788 is the actual break-in point. 

Figure 4—24(a) shows the root locus diagram when T — 0.5 sec. The critical 
value of gain K for this case is obtained by use of the magnitude condition, which 
can be obtained from Equation (4-26) as follows: 


(T 7 0.5 sec) 
la) 
Unit circle 
Im 
z plane 
K=2 {T = 1 sec} 
(b} 
Unit circle 
(T = 2 sec} 


(c) 


Unit circle 


Figure 4-24 (a) Root locus diagram for the system shown in Figure 4-23 when 
T = 0.5 sec; (b) root locus diagram when T = 1 sec; (c) root locus diagram when 
T — 2 sec. 
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z(1— e`) EE 
z2-10)G-e^) K 
For the present case, T' — 0.5 and this last equation becomes 
0.3935z 1 
(2-1 - 0.606) ^ K eun) 
Since the critical gain K. corresponds to point z = —1, we substitute —1 for z in 
Equation (4—28): 
0.3935(-1) | 1 
(-2)(—1.6065) K 


Or 
K = 8.165 


The critical gain K, is thus 8.165. 
The closed-loop poles corresponding to K = 2 can be found to be 


zı = 0.4098 + j0.6623 and z2 = 0.4098 — j0.6623 


These closed-loop poles are indicated by dots in the root locus diagram. 
2. Sampling period T = 1 sec: For this case, Equation (4-25) becomes as 
follows: 


0.6321Kz 
(z — 1)(z — 0.3679) 


Hence, G(z) has poles at z = 1 and z = 0.3679 and a zero at z = 0. 

The breakaway point and break-in point are found to be z — 0.6065 and 
z — —0.6065, respectively. The corresponding gain values are K — 0.2449 and 
K = 4.083, respectively. 

Figure 4—24(b) shows the root locus diagram when T = 1 sec. The critical value 
of gain K is 4.328. The closed-loop poles corresponding to K — 2 are found to be 


zı = 0.05185 + j0.6043 and z = 0.05185 — j0.6043 


and are shown in the root locus diagram by dots. 
3. Sampling period T — 2 sec: For this case, Equation (4—25) becomes 


0.8647 Kz 
(z — 1)(z — 0.1353) 


We see that G(z) has poles at z = 1 and z = 0.1353 and a zero at z = 0. 

The breakaway point and break-in point are found to be z — 0.3678 and 
z = —0.3678, with corresponding gain values K = 0.4622 and K = 2.164, respec- 
tively. The critical value of gain K for this case is 2.626. 

Figure 4—24(c) shows the root locus diagram when T = 2 sec. The closed-loop 
poles corresponding to K — 2 are found to be 


zı = —0.297] + j0.2169 and zı = —0.2971 — j0.2169 


G(z) = 


G(z) = 


These closed-loop poles are shown by dots in the root locus diagram. 


ed 
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Effects of Sampling Period T on Transient Response Characteristics. The tran- 
sient response characteristics of the discrete-time control system depend on the 
sampling period T. A large sampling period has detrimental effects on the relative 
stability of the system. A rule of thumb is to sample eight to ten times during a cycle 
of the damped sinusoidal oscillations of the output of the closed-loop system, if it 
is underdamped. For overdamped systems, sample eight to ten times during the rise 
time in the step response. 

As seen from the preceding analysis, for a given value of gain K, increasing 
the sampling period T will make the discrete-time control system less stable and 
eventually will make it unstable. Conversely, making the sampling period T shorter 
allows the critical value of gain K for stability to be larger. In fact, making the 
sampling period shorter and shorter tends to make the system behave more like the 
continuous-time system. (For the continuous-time second-order control system, the 
critical gain for stability is infinity, or K = ~.) 

For the system shown in Figure 4-23, the damping ratio ¢ for the closed-loop 
poles for K = 2 for each of the preceding three cases can be found from Figure 4-25. 
Graphically, the damping ratios for the closed-loop poles corresponding to T = 0.5, 
T = 1, and T = 2 are determined approximately as ¢ = 0.24, ¢ = 0.32, and ¢ = 0.37, 
respectively. 

The damping ratio ¢ of a closed-loop pole can be analytically determined from 
the location of the closed-loop pole in the z plane. If the damping ratio of a 
closed-loop pole is £, then in the s plane the closed-loop pole location (in the upper 
half-plane) can be given by 


S = —£o, + jo, V1— 2 


Since z — e^, the corresponding point in the z plane is 


= exp[T(— fa, T Jos vl- £) 


143.87? 


Figure 4-25 Closed-loop pole locations in the z plane shown with constant £ loci. 
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from which we get 


|z| = ec Tn (4-29) 
and 
Lz = To, V1 - È = To, = 0 (rad) (4-30) 


From Equations (4-29) and (4-30), the value of ¢ can be calculated. For example, 
in the case where the sampling period T is 0.5 sec, we have the closed-loop pole for 
K = 2 at z = 0.4098 + j0.6623. Hence, 


|z| = V0.4098? + 0.6623? = 0.7788 
By solving 
|z| = e 7» = 0.7788 


for the exponent, we find 


Tío, = 0.25 (4-31) 
Also, 
i tan 1 0 = 58.25° = 1.0167 rad 
Hence, 
Zz = Tw, V1 - = 1.0167 rad (4-32) 
From Equations (4-31) and (4-32), we obtain 
Tio,  _ 0.25 
To, V1- @ 1.0167 
Or 
—£ = 02459 
V1- 2 
which yields 
£ = 0.2388 


(From Figure 4-25 we graphically obtained 0.24 for £, which is very close to the 
actual £ value of 0.2388.) 

It is important to point out that in the second-order system the damping ratio 
£ is indicative of the relative stability (for example, in respect to the maximum 
overshoot in the unit-step response) only if the sampling frequency is sufficiently 
high (so that there are eight to ten samplings in a cycle of oscillation). If the sampling 
frequency is not high enough, the maximum overshoot in the unit-step response will 
be much higher than would be predicted by the damping ratio Z. 

To compare the effects of different sampling periods T on the transient re- 
sponse, we shall compare the unit-step response sequences for the three values of 
T considered in the preceding analysis. 
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The closed-loop pulse transfer function for the system of Figure 4-23, whose 
feedforward pulse transfer function G(z) is given by Equation (4—25), is 
Cz) Gz) . Kz(1— e) 
R(z) 1+ G(z) (z-1)(z-—e?7)-Kz(1—-e7) 


For T = 0.5 sec and K = 2, the unit-step response can be given by 


0.3935 x 2z 
CO) = GIDE = 0.6065) + 0.3935 x 22 (^) 
0.78702! 1 


~ T= 0.819527" + 0.606522 1 = z` 


from which we obtain the unit-step response sequence c(kT) versus kT shown in 
Figure 4—26(a). 

From Figure 4-25 we see that the angle 0 of the line connecting the origin and 
the dominant closed-loop pole at z = 0.4098 + /0.6623 (this line is a constant w line 
in the s plane) is approximately 58.25°. The angle 0 of the dominant closed-loop poles 
determines the number of samples per cycle of sinusoidal oscillation. Note that 


e 
0 


Hence, for 0 = 58.25°, we have 3607/0 = 360°/58.25° = 6.18 samples per cycle of 
damped oscillation, as seen from Figure 4—26(a). 
Similarly, for T = 1 sec and K = 2, the unit-step response is given by 


1.2642 ! 1 
— 0.10377! + 0.36792 2 1 - z ! 


The unit-step response sequence c(KT) versus KT is shown in Figure 4—26(b). Since 
the angle of the line connecting the origin and the closed-loop pole for the present 
case is 85.10°, as shown in Figure 4—25, we have approximately 360°/85.10° = 4.23 
samples per cycle, which is very much less than what we normally recommend. (We 
recommend eight or more samples per cycle of damped sinusoidal oscillation.) 
Finally, for T = 2 sec and K = 2, the unit-step response is given by 
1.729427! 1 


C(2) = 11 0594177 + 0.135322 1 — 77 


cos 6k = cos ok + 


C) = 7 


The unit-step response sequence c(KT) versus kT is shown in Figure 4-26(c). From 
Figure 4—25, the angle of the line connecting the origin and the closed-loop pole for 
the present case is 143.87°, and consequently we have 360°/143.87° = 2.50 samples 
per cycle, as seen from Figure 4~26(c). (Note that a slow sampling frequency such 
as 2.50 samples per cycle is unacceptable.) 

Figure 4—26 has shown three different plots of the unit-step response sequence 
C(kT) versus kT. As can be seen from these plots, if the sampling period is small, 
a plot of c(kT) versus kT will give a fairly accurate portrait of the response c(t). 
However, if the sampling period is not sufficiently small, then the plot of c(kT) 
versus kT will not portray an accurate result. It is very important to choose an 
adequate sampling period based on the satisfaction of the sampling theorem, system 
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Figure 4-26 (a) Unit-step response sequence of the system shown in Figure 4-23 
when T = 0.5 sec and K = 2; (b) unit-step response sequence when T = 1 sec and 
K = 2; (c) unit-step response sequence when T = 2 sec and K = 2. 
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dynamics, and actual hardware considerations. Note that barely satisfying the sam- 
pling theorem is not sufficient. An acceptable rule of thumb is to have eight to ten 
samples per cycle (six samples per cycle is marginal) if the system is underdamped 


and exhibits oscillation in the response. 


Next, let us investigate the effect of the sampling period T on the steady-state 
accuracy. We shall consider the unit-ramp response for each of the three cases. 
For the case where the sampling period T is 0.5 sec and gain K is 2, the 


open-loop pulse transfer function is 
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0.7870z 
(z — 1)(z — 0.6065) 


and the static velocity error constant K, is given by 


G(z) = 


= eet 
Ko cg = ee) 
z1 T 
NN f -1 0.7870z | 
z1 | 0.5z (z — 1)(z — 0.6065) 
=4 


Thus, the steady-state error in response to a unit-ramp input is 


1 1 
E gona 


Similarly, for the case where T = 1 secand K = 2, the open-loop pulse transfer 
function is 


1.2642z 
(z — 1)(z — 0.3679) 


and the static velocity error constant K, is given by 
(1 = z )G(z) 
T 


GG) = 


K, — lim 


zl 


= É -1 1.2642z | 
z (z —1)(z — 0.3679) 


and the steady-state error in response to a unit-ramp input is 


Finally, for the case where T = 2 sec and K = 2, the open-loop pulse transfer 
function is 


1.7294z 
(z — 1)(z — 0.1353) 


and the static velocity error constant K, and the steady-state error in response to a 
unit-ramp input are obtained, respectively, as 


K, =1 


G(z) = 


and 


ose Hl 


Parts (a), (b), and (c) of Figure 4-27 show, respectively, the plots of the unit-ramp 
response sequence c(kT) versus kT for the three cases considered. 


220 Design of Discrete-Time Control Systems by Conventional Methods Chap. 4 
c(kT) 
6 


Steady-state error = 0.25 
(a) 4 


[^] 
= 
N 
[^ 
> 


5 kT (sec) 


c(kT) 


Steady-state error = 0.50 


(b) 4 


0 1 2 3 4 5 6 kT (sec) 


c(kT) 


Steady-state error - 1.00 


(c) 6 


0 1 2 3 4 5 6 7 8 9 kT (sec) 


Figure 4-27 (a) Unit-ramp response sequence of the system shown in Figure 4-23 
when T = 0.5sec and K = 2; (b) unit-ramp response sequence when T = 1 sec and 
K = 2; (c) unit-ramp response sequence when T = 2 sec and K = 2. 


The three cases we have considered demonstrate that increasing the sampling 
period T adversely affects the system's relative stability. (It may even cause instabil- 
ity in some cases.) It is important to remember that the damping ratio ¢ of the 
closed-loop poles of the digital control system is indicative of the relative stability 
only if the sampling frequency is sufficiently high (that is, eight or more samples per 
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cycle of damped sinusoidal oscillation). If the sampling frequency is low (that is, less 
than six samples per cycle of damped sinusoidal oscillation), then predicting the 
relative stability from the damping ratio value is erroneous. 


Example 4-9 


Consider the digital control system shown in Figure 4-28. In the z plane, design a digital 
controller such that the dominant closed-loop poles have a damping ratio ¢ of 0.5 and 
a settling time of 2 sec. The sampling period is assumed to be 0.2 sec, or T = 0.2. Obtain 
the response of the designed digital control system to a unit-step input. Also, obtain 
the static velocity error constant K, of the system. 

For the standard second-order system having a pair of dominant closed-loop 
poles, the settling time of 2 sec means that 


= 4 = 
wn 0.50, 


which gives the undamped natural frequency w, of the dominant closed-loop poles as 


settling time = 2 


w, = 4 
The damped natural frequency wa is determined to be 
wa = V1 — 2 = 4V 1 — 0.5? = 3.464 


Since the sampling period T is 0.2 sec, we have 


2m 220 
Ws 77027 107 = 31.42 


[Notice that there are approximately nine samples per cycle of damped oscillation 
(31.42/3.464 = 9.07). Thus, the sampling period of 0.2 sec is satisfactory.] 

We shall first locate the desired dominant closed-loop poles in the z plane. 
Referring to Equations (4-29) and (4-30), for a constant-damping-ratio locus we have 


|z| =e ™% = ex __ 2a _ a 
zi = P TENE" TP o 
and 
[2 = To, = 20 
Qs 
From the given specifications (£ = 0.5 and wz = 3.464), the magnitude and angle of the 
dominant closed-loop pole in the upper half of the z plane are determined as follows: 
2m x 0.5 264) 


lel = ev[- Vi 0.57 3142 


Digital Zero-order 
controller hold 


=e °° = 0.6703 


ERE 
s(s + 2) 


Figure 4-28 Digital control system for Example 4-9. 
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and 


£= rn ss = 0.6927 rad = 39.69° 


We can now locate the desired dominant closed-loop pole in the upper half of the z 
plane, shown in Figure 4-29 as point P. Note that at point P 


z = 0.6703 /39.69* = 0.5158 + j0.4281 


Noting that the sampling period T is 0.2 sec, the pulse transfer function G(z) of 
the plant preceded by the zero-order hold can be obtained as follows: 


1-.&9? 1 ES 1 
ea) -z s s(s + " = xs + zl 


This last equation can be written as 


_ 0.01758(z + 0.8760) 
GG) = CG - 0.6703) 


Next, we locate the poles (z = 1 andz = 0.6703) and zero (z = —0.8760) of G(z) 
on the z plane, as shown in Figure 4-29. If point P is to be the location for the desired 
dominant closed-loop pole in the upper half of the z plane, then the sum of the angles 
at point P must be equal to + 180°. However, the sum of the angle contributions at point 
P is 

17.10° — 138.52° — 109.84° = —231.26° 
Hence, the angle deficiency is 
—231.26° + 180? = —51.26° 


The controller pulse transfer function must provide +51.26°. The pulse transfer func- 
tion for the controller may be assumed to be 


Figure 4-29 Root locus diagram of the system considered in Example 4-9. 


OM 
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zt+a 
z+B 
where K is the gain constant of the controller. 

If we decide to cancel the pole at z = 0.6703 by the zero of the controller at 
z = —a, then the pole of the controller can be determined (from the condition that the 
controller must provide +51.26°) as a point at z = 0.2543 (8 = —0.2543). Thus, the 
pulse transfer function for the controller may be determined as 
z — 0.6703 
z — 0.2543 


The open-loop pulse transfer function now becomes 

z — 0.6703 0.01758(z + 0.8760) 
z — 0.2543 (z — 1){z — 0.6703) 
_ „0.01758(z + 0.8760) 

^ ^ (z = 0.2543)(z — 1) 


Go(z) = K 


Gp(z) =K 


Gp(z)G(z) =K 


The gain constant K can be determined from the following magnitude condition: 
IG»(z)G(z)|. = 0.5158 + j0.4281 = 1 
Hence, 


0.01758(z + 0.8760) _ 
(z ~ 0.2543)(z — 1) 12=0.5158+;0.4281 


which gives 


K = 12.67 
The designed digital controller is 
z — 0.6703 
Gp(z) = 12.67 0.2543 (4-33) 


The open-loop pulse transfer function for the present system is 


12.67 x 0.01758(z + 0.8760) — 0.2227(z + 0.8760) 
(z — 0.2543)(z — 1) (z — 0.2543)(z — 1) 


Hence, the closed-loop pulse transfer function is 


Gp(z)G(z) = 


C(z _ _Gp(z)G(z) _ __0.2227z + 0.1951 
R(z) 1+ G»(z)G(z) z^ — 1.0316z + 0.4494 


The response to the unit-step input R(z) = 1/(1 — z ') can be obtained from 


C(z) = 0.2227z + 0.1951 1 
z? — 1.0316z + 0.44941 — z^! 


0.2227z ! + 0.1951z ? 1 


1-106: -04494; ?1-z 


Figure 4-30 shows the unit-step response sequence c(kT) versus kT. The plot 
shows that the maximum overshoot is approximately 1696 (which means that the 
damping ratio is approximately 0.5) and the settling time is approximately 2 sec. The 
digital controller just designed satisfies the given specifications and is satisfactory. 


224 Design of Discrete-Time Control Systems by Conventional Methods Chap. 4 


c(kT) 


0 0.4 0.8 1.2 1.6 2.0 2.4 2.8 3.2 3.6 4.0 
kT (sec) 


Figure 4-30 Unit-step response sequence of the system designed in Example 4-9. 


The static velocity error constant K, of the system is given by 


Lgs |Z 2:2227 + 0.8760) 
- Z2Ü[02z (z — 0.2543)(z — 1) 


= 2.801 


If it is required to have a large value of K,, then we may include a lag compen- 
sator. For example, adding a zero at z = 0.94 and a pole at z = 0.98 would raise the 
K, value three times, since (1 — 0.94)/(1 — 0.98) = 3. (It is important that the pole and 
zero of the lag compensator lie on a finite number of allocable discrete points.) A lag 
compensator, which has a pole and a zero very close to each other, does not significantly 
change the root locus near the dominant closed-loop poles. The effect of a lag compen- 
sator on the transient response is to introduce a small but slowly decreasing transient 
component. Such a small but slow transient, however, is not desirable from the view- 
point of disturbance or noise attenuation, since the response to disturbances would not 
attenuate promptly. 

Finally, it is noted that although the designed system is of the third order, it acts 
as a second-order system, since one pole of the plant has been canceled by the zero of 
the controller. Because of this, the present system has only two closed-loop poles. The 
dominant closed-loop poles are the only closed-loop poles in this case. If a pole and a 
zero do not cancel each other, then the system will be of the third order. 


Comments. It is important to note that the poles of the closed-loop pulse 
transfer function determine the natural modes of the system. The transient response 
and frequency response behaviors, however, are strongly influenced by the zeros of 
the closed-loop pulse transfer function. 
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Familiarity with the relationship between the z plane pole and zero locations 
and the time response characteristics is useful in designing discrete-time control 
systems. It is important to note that in the s plane adding a zero on the negative real 
axis near the origin increases the maximum overshoot in response to a step input. 
Such a zero in the s plane is mapped to a zero on the positive real axis in the z plane 
between 0 and 1. Therefore, in the z plane, adding a zero on the positive real axis 
between 0 and 1 increases the maximum overshoot. In fact, moving a zero toward 
point z — 1 will greatly increase the maximum overshoot. 

Similarly, in the s plane a closed-loop pole on the negative real axis near the 
origin increases the settling time. In the z plane, such a closed-loop pole is mapped 
to a closed-loop pole on the positive real axis between 0 and 1. Thus, a closed-loop 
pole in the z plane between 0 and 1 (in particular, near point z = 1) increases the 
settling time. The presence of a closed-loop pole or zero on the negative real axis 
between 0 and —1 in the z plane, however, affects the transient response only 
slightly. 


4-6 DESIGN BASED ON THE FREQUENCY-RESPONSE METHOD 


The frequency-response concept plays the same powerful role in digital control 
systems as it does in continuous-time control systems. As stated earlier, it is 
assumed in this book that the reader is familiar with conventional frequency- 
response design techniques for continuous-time control systems. In fact, familiarity 
with Bode diagrams (logarithmic plots) is necessary in the extension of the conven- 
tional frequency-response techniques to the analysis and design of discrete-time 
control systems. 

Frequency-response methods have very frequently been used in the compen- 
sator design. The basic reason is the simplicity of the methods. In performing 
frequency-response tests on a discrete-time system, it is important that the system 
have a low-pass filter before the sampler so that sidebands are filtered out. Then the 
response of the linear time-invariant system to a sinusoidal input preserves the fre- 
quency and modifies only the amplitude and phase of the input signal. Thus, the 
amplitude and phase are the only two quantities that must be dealt with. 

In the following, we shall analyze the response of the linear time-invariant 
discrete-time system to a sinusoidal input; this analysis will be followed by the 
definition of the sinusoidal pulse transfer function. Then we discuss the design of a 
discrete-time control system in the w plane by use of a Bode diagram. 


Response of a Linear Time-Invariant Discrete-Time System to a Sinusoidal Input. 
Earlier in this book we stated that the frequency response of G(z) can be obtained 
by substituting z = e/*" into G(z). In what follows we shall show that this is indeed 
true. 

Consider the stable linear time-invariant discrete-time system shown in Fig- 
ure 4-31. The input to the system G(z) before sampling is 


u(t) = sin wt 
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Stable linear 
time-invariant 
discrete-time 
system 


u(t) " sinct | 


T 


G(z) 


Figure 4-31 Stable linear time-invariant discrete-time system. 


The sampled signal u(kT) is 
u(kT) = sinkoT 
The z transform of the sampled input is 


z sinwT 


U(z) = Z [sinkoT] = G ey - e #7) 


The response of the system is given by 
X(@) = GEUG) = GG) Ears 


eT )(z = eT) 


Boc SV VIE eed [terms due to poles of G(z)] (4-34) 


zg — ell z= eT 


Multiplying both sides of Equation (4-34) by (z — e/#7)/z, we obtain 


i Z(z — oT — pjeT 
GG) BST -a-c pm + = [terms due to poles of G(z)] 


z ze 


The second term on the right-hand side of this last equation approaches zero as z 
approaches e/^", Since the system considered here is stable, the third term on the 
right-hand side also approaches zero as z approaches e/. Hence, by letting z 
approach e/^", we have 


sin oT G(e"T) 
a= G(z)- cl "ET z=ejoT = 2j 
The coefficient @, the complex conjugate of a, is then obtained as follows: 
zu: Ge*) 
= 5 


Let us define 
G(e/*") = Me” 
Then 
G(e T") = Me 
Equation (4—34) can now be written as 
Me? z Me? z 


X(z) = E SU EN c + [terms due to poles of G(z)] 
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Or 
M( ez RE: | 
X(z) 2j (; el Gage [terms due to poles of G(z)] 
The inverse z transform of this last equation is 


x(kT) = 2 p — e FT eit) + Z~! [terms due to poles of G(z)] (4-35) 


The last term on the right-hand side of Equation (4—35) represents the transient 
response. Since the system G(z) has been assumed to be stable, all transient 
response terms will disappear at steady state and we will get the following steady- 
state response x, (kT): 


XS(kT) = so — e ^19] = M sin(kwT + @) (4-36) 
where M, the gain of the discrete-time system when subjected to a sinusoidal input, 
is given by 

M = M(w) = |G(e”*")| 
and 6, the phase angle, is given by 
0 = 6(v) = / G(e") 
In terms of G(e/^"), Equation (4-36) can be written as follows: 
xs(kT) = |G(e’*?)| sin(koT + / G(e")) 
We have shown that G (e/^") indeed gives the magnitude and phase of the frequency 
response of G(z). Thus, to obtain the frequency response of G(z), we need only to 


substitute e/^" for z in G(z). The function G(e/^") is commonly called the sinusoidal 
pulse transfer function. Noting that 


eetQn/T)T = ei" T e?7 = eet 


we find that the sinusoidal pulse transfer function G (e/^") is periodic, with the period 
equal to T. 


Example 4-10 
Consider the system defined by 
Xx(kT) = u(kT) + ax((k — 1)T), 0<a<1 


where u(kT) is the input and x(kT) the output. Obtain the steady-state output x(kT) 
when the input u(kT) is the sampled sinusoid, or u(kT) = A sinkoT. 
The z transform of the system equation is 


X(z) = U(z) + az ! X(z) 
By defining G(z) = X(z)/U(z), we have 


_ XZ) __ 1 
G(z) T MUTET 
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Let us substitute e/"" for z in G(z). Then the sinusoidal pulse transfer function G(e/*") 
can be obtained as 

1 1 

jeTA = er a 
GESI 1—ae™" 1-—acosoT + ja sinwT 
The amplitude of G(e/"") is 


IG(e^")| = M 


1 
V1- a - 2a cosoT 


and the phase angle of G(e/"") is 


DECOY LRL e Fa 
Then the steady-state output x. (kT) can be written as follows: 
x«(kT) = AM sin(kwT + 0) 
A a sin eT ) 


= — sn (kor — tan ! ———— ——— 
V1-c a? — 2a cosoT 1—acosoT 


Bilinear Transformation and the w Plane. Before we can advantageously 
apply our well-developed frequency-response methods to the analysis and design of 
discrete-time control systems, certain modifications in the z plane approach are 
necessary. Since in the z plane the frequency appears as z = e/*", if we treat 
frequency response in the z plane, the simplicity of the logarithmic plots will be 
completely lost. Thus, the direct application of frequency-response methods is not 
worthy of consideration. In fact, since the z transformation maps the primary and 
complementary strips of the left half of the s plane into the unit circle in the z plane, 
conventional frequency-response methods, which deal with the entire left half 
plane, do not apply to the z plane. 

The difficulty, however, can be overcome by transforming the pulse transfer 
function in the z plane into that in the w plane. The transformation, commonly called 
the w transformation, a bilinear transformation, is defined by 


1 (Tw 
7" T= (TAN 


where T is the sampling period involved in the discrete-time control system under 
consideration. By converting a given pulse transfer function in the z plane into a 
rational function of w, the frequency-response methods can be extended to discrete- 
time control systems. By solving Equation (4-37) for w, we obtain the inverse 
relationship 


(4-37) 


geet 
Tzt+ 


(4-38) 


Through the z transformation and the w transformation, the primary strip of 
the left half of the s plane is first mapped into the inside of the unit circle in the z 
plane and then mapped into the entire left half of the w plane. The two mapping 
processes are depicted in Figure 4-32. (Note that in the s plane we consider only the 
primary strip.) Notice that the origin of the z plane is mapped into the point 
w = —2/T in the w plane. Notice also that, as s varies from 0 to j«/2 along the jw 


Sec. 4-6 Design Based on the Frequency-Response Method 229 


È w plane 


(a) (b) lc) 


Figure 4-32 Diagrams showing mappings from the s plane to the z plane and from the z plane 
to the w plane. (a) Primary strip in the left half of the s plane; (b) z plane mapping of the primary 
strip in the s plane; (c) w plane mapping of the unit circle in the z plane. 


axis in the s plane, z varies from 1 to —1 along the unit circle in the z plane and w 
varies from 0 to œ% along the imaginary axis in the w plane. 

Although the left half of the w plane corresponds to the left half of the s plane 
and the imaginary axis of the w plane corresponds to the imaginary axis of the s plane, 
there are differences between the two planes. The chief difference is that the 
behavior in the s plane over the frequency range —}@, = w < } w, maps to the range 
—o < y < c, where v is the fictitious frequency in the w plane. This means that, 
although the frequency response characteristics of the analog filter will be repro- 
duced in the discrete or digital filter, the frequency scale on which the response 
occurs will be compressed from an infinite interval in the analog filter to a finite 
interval in the digital filter. 

Once the pulse transfer function G(z) is transformed into G(w) by means of 
the w transformation, it may be treated as a conventional transfer function in w. 
Conventional frequency-response techniques can then be used in the w plane, and 
so the well-established frequency-response design techniques can be applied to the 
design of discrete-time control systems. 

As noted earlier, v represents the fictitious frequency. By replacing w by jv, 
conventional frequency-response techniques may be used to draw the Bode diagram 
for the transfer function in w. (In the brief review of the Bode diagrams in this 
section, we shall use the fictitious frequency v as the variable.) 

Although the w plane resembles the s plane geometrically, the frequency axis 
in the w plane is distorted. The fictitious frequency v and the actual frequency w are 
related as follows: 


w . 2z-1 2 e" —1 
= jp = — == 

e T TF Leet T eet +] 

2 güer — g-jümer — oT 


=p J tan 


—OT eer 4 pier 2 
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Or 


v= 2 tan St (4-39) 
Equation (4-39) gives the relationship between the actual frequency w and the 
fictitious frequency v. Note that as the actual frequency w moves from —1 c, to 0 the 
fictitious frequency v moves from —^ to 0, and as w moves from 0 to }a,, v moves 
from 0 to o. 

Referring to Equation (4-39), the actual frequency w can be translated into the 
fictitious frequency v. For example, if the bandwidth is specified as œw, then the 
corresponding bandwidth in the w plane is (2/T) tan (w, T/2). Similarly, G(jvi) 
corresponds to G( ja), where w = (2/T) tan ! (v, T/2). Figure 4—33 shows the rela- 
tionship between the fictitious frequency v times į T and the actual frequency « for 
the frequency range between 0 and }a,. 

Notice that in Equation (4-39) if wT is small then 


v=o 
This means that for small wT the transfer functions G(s) and G(w) resemble each 
other. Note that this is the direct result of the inclusion of the scale factor 2/T in 
Equation (4-38). The presence of this scale factor in the transformation enables us 
to maintain the same error constants before and after the w transformation. (This 


means that the transfer function in the w plane will approach that in the s plane as 
T approaches zero. See Example 4-11, which follows.) 


Example 4-11 


Consider the transfer-function system shown in Figure 4-34. The sampling period T is 
assumed to be 0.1 sec. Obtain G(w). 
The z transform of G(s) is 


T 
zx Vv 
2 
6 ! 
5 i 
4 
3 
2 
| 
1 
Figure 4-33 Relationship between the 
fictitious frequency v times į T and the 
0 


«€ actual frequency w for the frequency 
range between 0 and ło. 


ale 
N| £ 
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G(s) 


Figure 4-34  Transfer-function system of Example 4-11. 
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By use of the bilinear transformation given by Equation (4-37), or 


_ 1+ (Tw _ 1+ 0.05w 
1-(TR2)w 1 - 0.05w 


G(z) can be transformed into G(w) as follows: 


Gw) = 0.6321 _ 0.6321(1 — 0.05w) 
w) = IE 0.3679 0-6321 + 0.06840w 
1 — 0.05w ` 
1 — 0.05w 
SA TEA 
Notice that the location of the pole of the plant is s = —10 and that of the pole 
in the w plane is w — —9.241. The gain value in the s plane is 10 and that in the w plane 


is 9.241. (Thus, both the pole locations and the gain values are similar in the s plane and 
the w plane.) However, G(w) has a zero at w = 2/T = 20, although the plant does not 
have any zero. As the sampling period T becomes smaller, the w plane zero at w = 2/T 
approaches infinity in the right half of the w plane. Note that we have 


PE 
"ur ME e EET 


This fact is very useful in checking the numerical calculations in transforming G(s) into 
G(w). 


To summarize, the w transformation, a bilinear transformation, maps the 
inside of the unit circle of the z plane into the left half of the w plane. The overall 
result due to the transformations from the s plane into the z plane and from the z 
plane into the w plane is that the w plane and the s plane are similar over the region 
of interest in the s plane. This is because some of the distortions caused by the 
transformation from the s plane into the z plane are partly compensated for by the 
transformation from the z plane into the w plane. 

Note that if 


baz” + biz”! +e + bm 


G(z) = 2+ az +e +a, , 
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where the a;'s and b;'s are constants, is transformed into the w plane by the trans- 
formation 


1 * (T/2)w 
771- (Tw 
then G(w) takes the form 
_ Bow" + iw"! t --- + B, 
G(w) 7 a W^ + a,w"! Tec On 


where the o;'s and the B's are constants (some of them may be zero). Thus, G(w) 
is a ratio of polynomials in w, where the degrees of the numerator and denominator 
may or may not be equal. Since G( jv) is a rational function of v, the Nyquist stability 
criterion can be applied to G(jv). In terms of the Bode diagram, the conventional 
straight-line approximation to the magnitude curve as well as the concept of the 
phase margin and gain margin apply to G( jv). 


Bode Diagrams. Design by means of Bode diagrams has been widely used in 
dealing with single-input-single-output continuous-time control systems. In particu- 
lar, if the transfer function is in a factored form, the simplicity and ease with which 
the asymptotic Bode diagram can be drawn and reshaped are well known. 

As stated earlier, the conventional frequency-response methods apply to the 
transfer functions in the w plane. Recall that the Bode diagram consists of two 
separate plots, the logarithmic magnitude |G(jv)| versus log v and the phase angle 
/ G(jv) versuslog v. Sketching of the logarithmic magnitude is based on the factoring 
of G( jv), so that it works on the principle of adding the individual factored terms 
instead of multiplying individual terms. Familiar asymptotic plotting techniques can 
be applied, and therefore the magnitude curve can be quickly drawn by using 
straight-line asymptotes. Using the Bode diagram, a digital compensator or digital 
controller may be designed with conventional design techniques. 

It is important to note that there may be a difference in the high-frequency 
magnitudes for G( jo) and G(jv). The high-frequency asymptote of the logarithmic 
magnitude curve for G( jv) may be a constant-decibel line (that is, a horizontal line). 
On the other hand, if lim, G(s) = 0, then the magnitude of G(jw) always ap- 
proaches zero (—% dB) as w approaches infinity. For example, referring to Example 
4-11, we obtained G(w) for G(s) as follows: 

1 - 0.05w 
G(w) = szaf + m] 
The high-frequency magnitude of G( jv) is 


1- oe) 


jv + 9.241) | ~ 0.4621 


lim |G(jv)| = lim | 9.241( 
while the high-frequency magnitude of the plant is 


10 


lim iw + 10 


won 


|=0 


The difference in the Bode diagrams at the high-frequency end can be explained as 
follows. First, recall that we are interested only in the frequency range 0 = w = 1o,, 
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which corresponds to 0 = v = c. Then, noting that v = %in the w plane corresponds 
to w = 1o, in the s plane, it can be said that lim, ~» |G(jv)| corresponds to lim, |10/ 
(jw + 10)|, which is a constant. (It is important to note that these two values are 
generally not equal to each other.) From the pole-zero point of view, it can be said 
that when |G(jv)| is a nonzero constant at v = c it is implied that G(w) contains 
the same number of poles and zeros. 

In general, one or more zeros of G(w) lie in the right half of the w plane. The 
presence of a zero in the right half of the w plane means that G(w) is a nonminimum 
phase transfer function. Therefore, we must be careful in drawing the phase angle 
curve in the Bode diagram. 


Advantages of the Bode Diagram Approach to the Design. The Bode diagram 
approach to the analysis and design of control systems is particularly useful for the 
following reasons: 


1. In the Bode diagram the low-frequency asymptote of the magnitude curve is 
indicative of one of the static error constants K,, K,, or K;. 


2. Specifications of the transient response can be translated into those of the 
frequency response in terms of the phase margin, gain margin, bandwidth, and 
so forth. These specifications can easily be handled in the Bode diagram. In 
particular, the phase and gain margins can be read directly from the Bode 
diagram. 

3. The design of a digital compensator (or digital controller) to satisfy the given 
specifications (in terms of the phase margin and gain margin) can be carried 
out in the Bode diagram in a simple and straightforward manner. 


Phase Lead, Phase Lag, and Phase Lag-Lead Compensation. Before we dis- 
cuss design procedures in the w plane, let us review the phase lead, phase lag, and 
phase lag-lead compensation techniques. 

Phase lead compensation is commonly used for improving stability margins. 
The phase lead compensation increases the system bandwidth. Thus, the system has 
a faster speed to respond. However, such a system using phase lead compensation 
may be subjected to high-frequency noise problems due to its increased high- 
frequency gains. 

Phase lag compensation reduces the system gain at higher frequencies without 
reducing the system gain at lower frequencies. The system bandwidth is reduced and 
thus the system has a slower speed of response. Because of the reduced high- 
frequency gain, the total system gain can be increased, and thereby low-frequency 
gain can be increased and the steady-state accuracy can be improved. Also, any 
high-frequency noises involved in the system can be attenuated. 

In some applications, a phase lag compensator is cascaded with a phase lead 
compensator. The cascaded compensator is known as a phase lag-lead compensator. 
By use of the lag-lead compensator, the low-frequency gain can be increased (which 
means an improvement in steady-state accuracy), while at the same time the system 
bandwith and stability margins can be increased. 

Note that the PID controller is a special case of a phase lag-lead controller. 
The PD control action, which affects the high-frequency region, increases the phase 
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lead angle and improves system stability, as well as increasing the system bandwidth 
(and thus increasing the speed of response). That is, the PD controller behaves in 
much the same way as a phase lead compensator. The PI control action affects the 
low-frequency portion and, in fact, increases the low-frequency gain and improves 
steady-state accuracy. Therefore, the PI controller acts as a phase lag compensator. 
The PID control action is a combination of the PI and PD control actions. The design 
techniques for PID controllers basically follow those of phase lag-lead compensa- 
tors. (In industrial control systems, however, each PID control action in the PID 
controller may be adjusted experimentally.) 


Some Remarks on the Coefficient Quantization Problem. From the viewpoint 
of microprocessor implementation of the phase lead, phase lag, and phase lag-lead 
compensators, phase lead compensators present no coefficient quantization prob- 
lem, because the locations of poles and zeros are widely separated. However, in the 
case of phase lag compensators and phase lag-lead compensators, the phase lag 
network presents a coefficient quantization problem because the locations of poles 
and zeros are close to each other. (They are near the point z — 1.) 

Since the filter coefficients must be realized by binary words that use limited 
numbers of bits, if the number of bits employed is insufficient, the pole and zero 
locations of the filter may not be realized exactly as desired and the resulting filter 
will not behave as expected. 

Since small deviations in the pole and zero locations from the desired locations 
can have significant effects on the frequency-response characteristics of the compen- 
sator, the digital version of the compensator may not perform as expected. To 
minimize the effect of the coefficient quantization problem, it is necessary to struc- 
ture the filter so that it is least subject to coefficient inaccuracies due to quantization. 

Because the sensitivity of the roots of polynomials to the parameter variations 
becomes severe as the order of the polynomial increases, direct realization of a 
higher-order filter is not desirable. It is preferable to place lower-order elements in 
cascade or in parallel, as discussed in Section 3-6. As a matter of course, from the 
outset if we choose poles and zeros of the digital compensator from allowable 
discrete points, then the coefficient quantization problem can be avoided. 

In the analog compensator, the poles and zeros of the compensator can be 
placed with an arbitrary accuracy. In converting an analog compensator to a digital 
compensator, the digital version of the lag compensator may involve considerable 
inaccuracies in the locations of poles and zeros. (The important thing to remember 
is that the poles and zeros of the filter in the z plane must lie on a finite number of 
allowable discrete points.) 


Design Procedure in the w Plane. Referring to the digital control system 
shown in Figure 4—35, the design procedure in the w plane may be stated as follows: 


1. First, obtain G(z), the z transform of the plant preceded by a hold. Then 
transform G(z) into a transfer function G(w) through the bilinear transforma- 
tion given by Equation (4-37): 

_ 1+ (T/2)w 
Z T= (T2w 
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Figure 4-35 Digital control system. 


That is, 


G(w) = G(z)l.-p«amwyn-aoamwi 


It is important that the sampling period T be chosen properly. A rule of thumb 
is to sample at the frequency 10 times that of the bandwidth of the closed-loop 
system. (Although digital controls and signal processing use similar approaches 
in sampling continuous-time signals, the sampling frequencies involved are 
very different. In the field of signal processing, sampling frequencies are 
generally very high, while in the field of digital control systems, the sampling 
frequencies used are generally low. Such a difference in the sampling fre- 
quencies is mainly due to the different dynamics involved and the different 
trade-offs in these two fields.) 

2. Substitute w = jv into G(w) and plot the Bode diagram for G( jv). 

3. Read from the Bode diagram the static error constants, the phase margin, and 
the gain margin. 

4. By assuming that the low-frequency gain of the discrete-time controller (or 
digital controller) transfer function Gp(w) is unity, determine the system gain 
by satisfying the requirement for a given static error constant. Then, by using 
conventional design techniques for continuous-time control systems, deter- 
mine the pole(s) and zero(s) of the digital controller transfer function. [Gp(w) 
is a ratio of two polynomials in w.] Then the open-loop transfer function of the 
designed system is given by Gp(w)G(w). 

5. Transform the controller transfer function Gp(w) into Gp(z) through the 
bilinear transformation given by Equation (4-38): 


VES UE 
Tz *1 


Then 


Gp(z) = Gp(w)l.-emo-we«» 
is the pulse transfer function of the digital controller. 
6. Realize the pulse transfer function Gp(z) by a computational algorithm. 


In following the design procedure just given, it is important to note the 
following: 
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1. The transfer function G(w) is a nonminimum phase transfer function. Hence, 
the phase angle curve is different from that for the more typical minimum phase 
transfer function. It is necessary to make sure that the phase angle curve is 
drawn correctly by taking into consideration the nonminimum phase term. 

2. The frequency axis in the w plane is distorted. The relationship between the 
fictitious frequency v and the actual frequency w is 

2 oT 


v= Tam 


If, for example, a bandwidth c, is specified, we need to design the system for 
a bandwidth v,, where 


V = 2 tan MF 
^" T 2 


Example 4-12 


Consider the digital control system shown in Figure 4-36. Design a digital controller 
in the w plane such that the phase margin is 50°, the gain margin is at least 10 dB, and 
the static velocity error constant K, is 2 sec. Assume that the sampling period is 
0.2 sec, or T = 0.2. 

First, we obtain the pulse transfer function G(z) of the plant that is preceded by 


the zero-order hold: 
- 1 EN e 9*5 K 
GG) zl 5 s(s + zl 


K 
=q -hol A _ 
=(1-z zla + 5 
K(z + 0.9356) 
(z — 1)(z — 0.8187) 
- K(0.01873z + 0.01752) 
z? — 1.8187z + 0.8187 


Next, we transform the pulse transfer function G(z) into a transfer function G(w) 
by means of the bilinear transformation given by Equation (4-37): 


_1+(TR2)w_ 1+0.1w 


| 1-(T2w 1-0.1w 


= ooien] 


Figure 4-36 Digital control system of Example 4-12. 
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Thus, 

K|0.01873| L +9” | + 0.01752 

1 - 0.1w 

Gon = 1 0.1wY 1 4 0.1w 
(He) — neis 10w) + 0.8187 

K(—0.000333w? — 0.09633w + 0.9966) 

w? + 0.9969w 

w w 
. «(1 + zh — x) 


w(w + 1) 

A simple phase-lead compensator will probably satisfy all requirements. There- 
fore, we shall try lead compensation. (If lead compensation does not satisfy all require- 
ments, we need to use a different type of compensation.) 

Now let us assume that the transfer function of the digital controller Gp (w) has 
unity gain for the low-frequency range and has the following form: 


1+ Tw 


G»(w) = 1+ arw’ 


0<a<l 


(This is a phase-lead compensator.) It is one of the simplest forms of the digital 
controller transfer function. (Other forms may be assumed as well for this problem.) 
The open-loop transfer function is 


_ 1+ rw K(-0.000333w^ — 0.09633w + 0.9966) 
G»()GQ) = TF arw w? + 0.9969w 
The static velocity error constant K, is specified as 2 sec '. Hence, 
K, = lim wGp(w)G(w) = K = 2 
w—0 


The gain K is thus determined to be 2. 
By setting K — 2, we plot the Bode diagram of G(w): 


— 2. 
Gy) = C: 0.000333w? — 0.09633 + 0.9966) 


w°? + 0.9969w 
w w 
- (i t al - x) 
7 w(w + 1) 


Figure 4-37 shows the Bode diagram for the system. For the magnitude curves 
we have used straight-line asymptotes. The magnitude and phase angle of G(jv) are 
shown by dashed curves. (Note that the zero at v = 10, which lies in the right half of 
the w plane, gives phase lag.) The phase margin can be read from the Bode diagram 
(dashed curves) as 30? and the gain margin as 14.5 dB. 

The given specifications require, in addition to K, = 2, the phase margin of 50° 
and a gain margin of at least 10 dB. Let us design a digital controller to satisfy these 
specifications. 


Design of lead compensator. Since the specification calls for a phase margin of 
50°, the additional phase-lead angle necessary to satisfy this requirement is 20°. To 
achieve a phase margin of 50° without decreasing the value of K, the lead compensator 
must contribute the required phase-lead angle. 
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Figure 4-37 Bode diagram for the system designed in Example 4-12. 


Noting that the addition of a lead compensator modifies the magnitude curve in 
the Bode diagram, the gain crossover frequency will be shifted to the right. Considering 
the shift of the gain crossover frequency, we may assume that ¢,,, the maximum 
phase-lead angle required, is approximately 28°. (This means that 8° has been added 
to compensate for the shift in the gain crossover frequency.) Since 


l-a 
lta 


sin Ọm = 


dm = 28° corresponds to a = 0.361. 

Once the attenuation factor a has been determined on the basis of the required 
phase-lead angle, the next step is to determine the corner frequencies v = 1/7 and v = 
1/(a7) of the lead compensator. To do so, we first note that the maximum phase-lead 
angle ¢,, occurs at the geometric mean of the two corner frequencies, or v = (Var). 
The amount of the modification in the magnitude curve at v = l/( Var) due to the 
inclusion of the term (1 + zjv)/(1 + ajv) is 


1+ jv _ 


1 
v= (Var) Va 


Next, we find the frequency point where the magnitude of the uncompensated 
system is equal to —20 log(1/V/a). Note that 


1 
V/0.361 


1+ arjv 


—20 log = —20 log 1.6643 = —4.425 dB 


Sec. 4-6 Design Based on the Frequency-Response Method 239 


To find the frequency point where the magnitude is —4.425 dB, we substitute w — jv 
in G(w) and find the magnitude of G( jv): 


IGGv) = 


By trial and error, we find that at v = 1.7 the magnitude becomes approximately 
—4.4 dB. We select this frequency to be the new gain crossover frequency v.. Noting 
that this frequency corresponds to (Var), or 


Ve = wae = 1.7 
we obtain 
T= l = 0.9790 
1.7Va 
and 
art = 0.3534 


The lead compensator thus determined is 


L+mw _ 1+ 0.9790w 


Go(w) = IF arw ~ 14+ 0.3534w 


(4-40) 
The magnitude and phase angle curves for Gp( jv) and the magnitude and phase angle 
curves of the compensated open-loop transfer function Gp( jv) G( jv) are shown by solid 
curves in Figure 4-37. From the Bode diagram we see that the phase margin is 50° and 
the gain margin is 14 dB. 

The controller transfer function given by Equation (4—40) will now be trans- 
formed back to the z plane by the bilinear transformation given by Equation (4-38): 


2z-1 72-21 z—1 


w=Fz1 02:71 i41 
Thus, 

1+ sero (10! — ) 

z+1 
Gp(z) = 

z-1 

1+ oasa 1045) 
z+1 

_ 2.3798z — 1.9387 
z — 0.5589 


The open-loop pulse transfer function of the compensated system is 
2.3798z — 1.9387 0.03746(z + 0.9356) 
z — 0.5589 (z — 1)(z — 0.8187) 


|... 0.0891z? + 0.0108z — 0.0679 
~ 23 — 2.37762? + 1.8852z — 0.4576 


Gp(z)G(z) = 
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The closed-loop pulse transfer function of the designed system is 


C(z) 0.08917? + 0.0108z — 0.0679 
R(z) z!- 22885z^- 1.8460z — 0.5255 


0.0891(z + 0.9357)(z — 0.8145) 
(z — 0.8126)(z — 0.7379 — j0.3196)(z — 0.7379 + j0.3196) 


Notice that the closed-loop pulse transfer function involves two zeros located at 
z = —0.9357 and z = 0.8145. The zero at z = 0.8145 almost cancels with the closed- 
loop pole at z = 0.8126. The effect of another zero at z = —0.9357 on the transient and 
frequency responses is very small, since it is located on the negative real axis of the z 


plane between 0 and —1 and is close to point z = —1. The pair of complex conjugate 
poles acts as dominant closed-loop poles. (The system behaves as if it is a second-order 
system.) 


To check the transient response of the designed system, we shall obtain the 
unit-step response of this system using MATLAB. MATLAB Program 4-2 produces 
the unit-step response curve as shown in Figure 4-38. The plot of the unit-step response 
exhibits a maximum overshoot of approximately 20% and a settling time of approxi- 
mately 4 sec. From this curve we see that the number of samples per cycle of sinusoidal 
oscillation is approximately 15. This means that the sampling frequency «, is 15 times 
the damped natural frequency w4. Thus, the sampling period of 0.2 sec is satisfactory 
under normal operation of this system. 


MATLAB Program 4—2 


-———— Unit-step response of designed system ---------- 


num = [0 0.0891 0.0108 -0.0679]; 
den = [1 -2.2885 1.8460 -0.5255]; 
r = ones(1,41); 

v=[0 40 O 1.6]; 

axis(v); 

k = 0:40; 

€ = filterí(num,den,r); 

plotik,c,'o') 

grid 

title('Unit-Step Response of Designed System") | 


xlabelk (Sampling period T = 0.2 sec)') 
ylabel(‘Output c(k)') 


Comments. The advantage of the w transform method is that the conven- 
tional frequency-response method using Bode diagrams can be used for the design 
of discrete-time control systems. In applying this method, we must carefully choose 
a reasonable sampling frequency. Before we conclude this section, we summarize 
the important facts about design in the w plane. 


1. The magnitude and phase angle of G( jv) are the magnitude and phase angle 
of G(z) as z moves on the unit circle from z = 1 to z = —1. Since z = e*7, 
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Figure 4-38 Plot of unit-step response of the designed system. 


the w value varies from 0 to },. The fictitious frequency v varies from 0 to co, 
since v = (2/T) tan (wT/2). Thus, the frequency response of the digital control 
system for 0 = w = t «œ is similar to the frequency response of the correspond- 
ing analog control system for 0 = v = o. 


Since G( jv) is a rational function of v, it is basically the same as G(jw). In 
determining possible unstable zeros of the characteristic equation, the Nyquist 
stability criterion can be applied. Therefore, both the conventional straight- 
line approximation to the magnitude curve in the Bode diagram and the 
concept of phase margin and gain margin apply to G( jv). 

Compare transfer functions G(w) and G(s). As we mentioned earlier, because 
of the presence of the scale factor 2/T in the w transformation, the correspond- 
ing static error constants for G(w) and G(s) become identical. (Without the 
scale factor 2/T, this will not be true.) 


The w transformation may generate one or more right half-plane zeros in 
G(w). If one or more right half-plane zeros exist, then G(w) is a nonminimum 
phase transfer function. Because the zeros in the right half-plane are generated 
by the sample-and-hold operation, the locations of these zeros depend on the 
sampling period T. The effects of these zeros in the right half-plane on the 
response become smaller as the sampling period T becomes smaller. 

In what follows, let us consider the effects on the response of the zero 
in the right half-plane at w = 2/T. The zero at w = 2/T causes distortion in the 
frequency response as v approaches 2/T. Since 

2 wT 
v= n tany 


T 2 
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then, as v approaches 2/T, tan (wT/2) approaches 1, or 


eT o7 
2 4 
and thus 
w = a 
2T 


As we stated earlier, w = w, = n/T is the highest frequency that we consider 
in the response of the discrete-time or digital control system. Therefore, 
w = w,/4 = mi2T, which is one-half the highest frequency considered, is well 
within the frequency range of interest. Thus, the zero at w — 2/T, which is in 
the right half of the w plane, will seriously affect the response. 


S. It should be noted that the Bode diagram method in the w plane is frequently 
used in practice, and many successful digital control systems have been de- 
signed by this approach. 


4-7 ANALYTICAL DESIGN METHOD 


The main reason why the control actions of analog controllers are limited is that there 
are physical limitations in pneumatic, hydraulic, and electronic components. Such 
limitations may be completely ignored in designing digital controllers. Thus, many 
control schemes that have been impossible with analog controls are possible with 
digital controls. In fact, optimal control schemes that are not possible with analog 
controllers are made possible by digital control schemes. 

In this section we specifically present an analytical design method for digital 
controllers that will force the error sequence, when subjected to a specific type of 
time-domain input, to become zero after a finite number of sampling periods and, 
in fact, to become zero and stay zero after the minimum possible number of sampling 
periods. 

If the response of a closed-loop control system to a step input exhibits the 
minimum possible settling time (that is, the output reaches the final value in the mini- 
mum time and stays there), no steady-state error, and no ripples between the 
sampling instants, then this type of response is commonly called a deadbeat response. 
The deadbeat response will be discussed in this section. (We shall treat the deadbeat 
response again in Chapter 6, where we discuss the pole placement technique and the 
design of state observers.) 

The discussions that follow are limited to the determination of the control 
algorithms or pulse transfer functions of digital controllers for single-input-single- 
output systems, given desired optimal response characteristics. For optimal control 
of multiple-input-multiple-output systems, see Chapter 8, where the state-space 
approach is used. 


Design of Digital Controllers for Minimum Settling Time with Zero Steady-State 
Error. Consider the digital control system shown in Figure 4—39(a). The error 
signal e(t), which is the difference between the input r(t) and the output c(t), is 
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(b) 


Figure 4-39 (a) A digital control system; (b) diagram showing equivalent digital 
control system. 


sampled every time interval T. The input to the digital controller is the error signal 
e(kT). The output of the digital controller is the control signal u(kT). The control 
signal u(kT) is fed to the zero-order hold, and the output of the hold, u(t), which 
is a piecewise continuous-time signal, is fed to the plant. [Although the sampler at 
the input of the zero-order hold is not shown, the signal u(kT) is first sampled and 
fed to the zero-order hold. As mentioned earlier, the zero-order hold shown in the 
diagram is a sample-and-hold device.] It is desired to design a digital controller 
Gp(z) such that the closed-loop control system will exhibit the minimum possible 
settling time with zero steady-state error in response to a step, a ramp, or an 
acceleration input. It is required that the output not exhibit intersampling ripples 
after the steady state is reached. The system must satisfy any other specifications, 
if required, such as a specification for the static velocity error constant. 

Let us define the z transform of the plant that is preceded by the zero-order 
hold as G(z), or 

-Ts 
G(z) = 2 6,6) 


Then the open-loop pulse transfer function becomes Gp(z)G(z), as shown in Figure 
4-39(b). Next, define the desired closed-loop pulse transfer function as F(z): 
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Cle) | G»()G() 
R(z) 1+ Gp(z)G(z) 
Since it is required that the system exhibit a finite settling time with zero steady-state 


error, the system must exhibit a finite impulse response. Hence, the desired closed- 
loop pulse transfer function must be of the following form: 


- F(z) (4-41) 


N N-1 
aoz + d1Z" — +++ + ay 
F(z) = ZN 
or 
F(z) = a + az™ +--+ + ayz™ (4-42) 


where N = n and nis the order of the system. [Note that F(z) must not contain any 
terms with positive powers in z, since such terms in the series expansion of F (z) imply 
that the output precedes the input, which is not possible for a physically realizable 
system.] In our design approach, we solve the closed-loop pulse transfer function for 
the digital controller pulse transfer function Gp(z). That is, we find the pulse transfer 
function Gp(z) that will satisfy Equation (4-41). Solving Equation (4-41) for Gp (z), 
we obtain 


F(z) 
G(z)[1 — F(z)] 

The designed system must be physically realizable. The conditions for physical 
realizability place certain constraints on the closed-loop pulse transfer function F (z) 


and the digital controller pulse transfer function Gp(z). The conditions for physical 
realizability may be stated as follows: 


Gp(z) = (4-43) 


1. The order of the numerator of Gp(z) must be equal to or lower than the order 
of the denominator. (Otherwise, the controller requires future input data to 
produce the current output.) 


2. If the plant G,(s) involves a transportation lag e "^, then the designed closed- 
loop system must involve at least the same magnitude of the transportation lag. 
(Otherwise, the closed-loop system would have to respond before an input was 
given, which is impossible for a physically realizable system.) 

3. If G(z) is expanded into a series in z^, the lowest-power term of the series 
expansion of F(z) in z~' must be at least as large as that of G(z). For example, 
if an expansion of G(z) into a series in z^! begins with the z^! term, then the 
first term of F(z) given by Equation (4—42) must be zero, or a; must equal 0; 
that is, the expansion has to be of the form 


F(z) = az! + az? + +++ + ayz™ 


where N = n and nis the order of the system. This means that the plant cannot 
respond instantaneously when a control signal of finite magnitude is applied: 
the response comes at a delay of at least one sampling period if the series 
expansion of G(z) begins with a term in z7!. 


~ amA 
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In addition to the physical realizability conditions, we must pay attention to 
the stability aspects of the system. Specifically, we must avoid canceling an unstable 
pole of the plant by a zero of the digital controller. If such a cancellation is attempted, 
any error in the pole-zero cancellation will diverge as time elapses and the system 
will become unstable. Similarly, the digital controller pulse transfer function should 
not involve unstable poles to cancel plant zeros that lie outside the unit circle. 

Next, let us investigate what will happen to the closed-loop pulse transfer 
function F(z) if G(z) involves an unstable (or critically stable) pole, that is, a pole 
z = a outside (or on) the unit circle. [Note that the following argument applies 
equally, if G(z) involves two or more unstable—or critically stable—poles.] Let us 
define 


G(z) = oe) 


where G,(z) does not include a term that cancels with z — a. Then the closed-loop 
pulse transfer function becomes 


Gi(z) 
CZ) | G»G)G() . o Oa = F(z) (4-44) 
R(z) 1+ Gp(z)G(z) TENES oie) 


Since we require that no zero of Gp(z) cancel the unstable “pole of G(z) atz = a, 
we must have 


1 z-a 


1- F(z) = GG) Z- a + Gp(z)G«(z) 


1+ Go(z) 


That is, 1 — F(z) must have z = a as a zero. Also, notice that from Equation (4-44) 
if zeros of G(z) do not cancel poles of Gp(z), the zeros of G(z) become zeros of 
F(z). [F(z) may involve additionai zeros.] 

Let us summarize what we have stated concerning stability. 


1. Since the digital controller Gp(z) should not cancel unstable (or critically 
stable) poles of G(z), all unstable (or critically stable) poles of G(z) must be 
included in 1 — F(z) as zeros. 

2. Zeros of G(z) that lie inside the unit circle may be canceled with poles of 
Gp(z). However, zeros of G(z) that lie on or outside the unit circle must not 
be canceled with poles of Gp(z). Hence, all zeros of G(z) that lie on or outside 
the unit circle must be included in F(z) as zeros. 


Now we shall proceed with the design. Since e(kT) = r(kT) — c(kT), referring 
to Equation (4-41) we have 


E(z) = R(z) - C(z) = R(z)[1 — F(z)] (4-45) 
Note that for a unit-step input r(t) = 1(f) 
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1 
R()-i—z4 
For a unit-ramp input r(t) = f1(t), 
Tz | 
RO = Gary 


And for a unit-acceleration input r(t) = }271(2), 
T + 27) 


R(z) = 2(1 _ zy 


Thus, in general, z transforms of such time-domain polynomial inputs may be 
written as 


P(z) 


R(z) = a-z" 


(4-46) 
where P(z) is a polynomial in z~'. Notice that for a unit-step input P(z) = 1 and 
q = 0; for a unit-ramp input, P(z) = Tz ! and q = 1; and for a unit-acceleration 
input, P(z) = 1T?^z !(1 + 271) and q =2. 

By substituting Equation (4-46) into Equation (4-45), we obtain 


E(z) = med (4-47) 


To ensure that the system reaches steady state in a finite number of sampling periods 
and maintains zero steady-state error, E(z) must be a polynomial in z^! with a finite 
number of terms. Then, by referring to Equation (4—47), we choose the function 
1 — F(z) to be of the form 


1 — F(22(1-z'!N(z) (4-48) 
where N(z) is a polynomial in z^! with a finite number of terms. Then 
E(z) = P(z)N(z) (4-49) 


which is a polynomial in z^! with a finite number of terms. This means that the error 
signal becomes zero in a finite number of sampling periods. 

From the preceding analysis, the pulse transfer function of the digital controller 
can be determined as follows. By first letting F(z) satisfy the physical realizability 
and stability conditions and then substituting Equation (4-48) into Equation (4—43), 
we obtain 


F(z) 


PO = Gy - y" NG) 


(4-50) 
Equation (4-50) gives the pulse transfer function of the digital controller that will 
produce zero steady-state error after a finite number of sampling periods. 

For a stable plant G, (s), the condition that the output not exhibit intersampling 
ripples after the settling time is reached may be written as follows: 
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c(t = nT) = constant, for step inputs 
ċ(t = nT) = constant, for ramp inputs 
c(t = nT) = constant, for acceleration inputs 


The applicable condition must be satisfied when the system is designed. In designing 
the system, the condition on c(t), c(t), or C(t) must be interpreted in terms of u(t). 
Note that the plant is continuous time and the input to the plant is u(1), a continuous- 
time function; therefore, to have no ripples in the output c(t), the control signal u(t) 
atsteady state must be either constant or monotonically increasing (or monotonically 
decreasing) for step, ramp, or acceleration inputs. 


Comments 


1. Since the closed-loop pulse transfer function F(z) is a polynomial in z~}, all 
the closed-loop poles are at the origin or at z = 0. The multiple closed-loop 
pole at the origin is very sensitive to system parameter variations. 

2. Although a digital control system designed to exhibit minimum settling time 
with zero steady-state error in response to a specific type of input has excellent 
transient response characteristics for the input it is designed for, it may exhibit 
inferior or sometimes unacceptable transient response characteristics for other 
types of input. (This is always true in optimal control systems. An optimal 
control system will exhibit the best response characteristics for the type of input 
it is designed for, but will not exhibit optimal response characteristics for other 
types of input.) 

3. In the case in which an analog controller is discretized, an increase in the 
sampling period changes the system dynamics and may lead to system instabil- 
ity. On the other hand, the behavior of the digital control system we are 
designing in this section does not depend on the choice of the sampling period. 
Since the inputs r(t) considered here are time-domain inputs (such as step 
inputs, ramp inputs, and acceleration inputs), the sampling period T can be 
chosen arbitrarily. For a smaller sampling period, the response time (which is 
an integral multiple of the sampling period T) becomes smaller. However, for 
a very small sampling period T, the magnitude of the control signal will become 
excessively large, with the result that saturation phenomena will take place in 
the system, and the design method presented in this section will no longer 
apply. Hence, the sampling period T should not be too small. On the other 
hand, if the sampling period T is chosen too large, the system may behave 
unsatisfactorily or may even become unstable when it is subjected to suffi- 
ciently time varying inputs (such as frequency-domain inputs). Thus, a compro- 
mise is necessary. A rule of thumb is to choose the smallest sampling period 
T such that no saturation phenomena occur in the control signal. 


Example 4-13 


Consider the digital control system shown in Figure 4-39(a), where the plant transfer 
function G,(s) is given by 


1 
G,(s) = GID 
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Design a digital controller Gp(z) such that the closed-loop system will exhibit a 
deadbeat response to a unit-step input. (In a deadbeat response the system should not 
exhibit intersampling ripples in the output after the settling time is reached.) The 
sampling period T is assumed to be 1 sec. Then, using the digital controller Gp(z) so 
designed, investigate the response of this system to a unit-ramp input. 

The first step in the design is to determine the z transform of the plant that is 
preceded by the zero-order hold: 


Gc) Zi -eh 1 | 


s s(s- 1) 
E 1 
FADE NE E 7 zl 
ER m EREE NC — 
) -z 1-z! 1-033679; 
| 0.3679(1 + 0.71812)! 
^" ü-z)ü- 036792) (4-51) 


Now redraw the block diagram of the system as shown in Figure 4-39(b). Define the 
closed-loop pulse transfer function as F(z), or 

C@) OOA . aa) 

R(z) 1+ Gp(z)G(z) 
Notice that if G (z) is expanded into a series in z~' then the first term will be 0.3679z ^! , 
Hence, F(z) must begin with a term in z™". 


Referring to Equation (4—42) and noting that the system is of the second order 
(n = 2), we assume F(z) to be of the following form: 


F(z) = az + az”? (4-52) 
Since the input is a step function, from Equation (4—48) we require that 
1-F(z)-(1-z )N(z) (4-53) 


Since G(z) has a critically stable pole at z = 1, the stability requirement states that 
T&F (z) must have a zero at z = 1. However, the function 1 — F(z) already has a term 
1 — z^! and therefore satisfies the requirement. 

Since the system should not exhibit intersampling ripples and the input is a step 
function, we require c(t = 2T) to be constant. Noting that u(t), the output of the 
zero-order hold, is a continuous-time function, a constant c(t = 2T) requires that u(t) 
also be constant for t = 2T. In terms of the z transform, U(z) must be of the following 
type of series in z~': 


U(z) = bo + biz tb(z?^tz?tz^ict4-) 


where b is a constant. Because the plant transfer function G, (s) involves an integrator, 
b must be zero. (Otherwise, the output cannot stay constant.) Consequently, we have 


U(z) xd bo + biz? 
From Figure 4—39(b), U(z) can be given as follows: 


.C€G) CG)RG). 


R(z) 
UG) Su RG)GG) 


" GG) 
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1 (1-z^)0 - 0.367927) 
1— z^! 0.3679(1 + 0.7181z ))z ` 


1 — 0.367927! 
0.3679(1 + 0.7181z )z! 


For U(z) to be a series in z~' with only two terms, F(z) must be of the following form: 


= F(z) 


= F(z) 


F(z) = (1 + 0.71812 )z F (4-54) 
where F, is a constant. Then U(z) can be written as follows: 
U(z) = 2.7181(1 — 0.36792 ')F, (4-55) 


Equation (4-55) gives U(z) in terms of A. Once constant F; is determined, U(z) can 
be given as a series in z ' with only two terms. 

Now we shall determine N(z), F(z), and F. By substituting Equation (4-52) into 
Equation (4—53), we obtain 


l-az'!-az?^-(-zPN() 


The left-hand side of this last equation must be divisible by 1 — z`". If we divide the 
left-hand side by 1 — 2^ ', the quotient is 1 + (1 — ai)z ' and the remainder is 
(1 — ai — a3)z ?. Hence, N(z) is determined as 


N)-1*(1—-a)! (4-56) 
and the remainder must be zero. This requires that 
l-a—-m=0 (4-57) 


Also, from Equations (4-52) and (4-54) we have 
F(z) = az + az? = (1 + 0.718127) A 
Hence, 
a + az! = (1 + 0.718127')A 


Division of the left-hand side of this last equation by 1 + 0.7181z '' yields the quotient 
a, and the remainder (a; — 0.7181a,)z~'. By equating the quotient with A and the 
remainder with zero, we obtain 


R-a 
and 
à, — 0.7181a, = 0 (4-58) 
Solving Equations (4-57) and (4-58) for a; and a; gives 
a, — 0.5820, à; = 0.4180 
Thus, F(z) is determined as 
F(z) = 0.5820z7' + 0.4180z ? (4-59) 
and 
F, = 0.5820 
Equation (4-56) gives 
N(z) = 1 + 0.418027? (4-60) 
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The digital controller pulse transfer function Gp(z) is then determined from Equation 
(4-50), as follows. By referring to Equations (4-51), (4-54), and (4—60), 
F(z) 

G(z)1 - z ')N(z) 
= (1 + 0.7181z~*)z~ (0.5820) 

0.3679(1 + 0.7181z z^! 

(1 — z7")(1 — 0.367927") 
_ 1.5820 — 0.5820z 

1 + 0.4180z7' 


With the digital controller thus designed, the closed-loop pulse transfer function 
becomes as follows: 


Gp(z) = 


(1 — 2 )(1 + 0.4180271) 


C(z) _ _ -1 -2 
RG) = F(z) = 0.5820z ^! + 0.4180z 
_ 0.5820(z + 0.7181) 
= 
Z 


The system output in response to a unit-step input r(t) = 1 can be obtained as follows: 


C(z) = F(z)R(z) 


= (0.58207 ' + 0.41807? —— 


= 0.582027 + 277 +274 z+. 
Hence, 
c(0) = 0 
c(1) = 0.5820 
c(k) = 1, k = 2,3,4,... 
Notice that substitution of 0.5820 for F; in Equation (4-55) yields 
U(z) = 2.7181(1 — 0.36792 (0.5820) 
= 1.5820 — 0.5820z^! 


Thus, the control signal u(k) becomes zero for k = 2, as required. There is no inter- 

sampling ripple in the output after the settling time is reached. Figure 4—40(a) shows 

plots of c(k) versus k, u(k) versus k, and u(t) versus t in the unit-step response. 
Next, let us investigate the response of this system to a unit-ramp input: 


C(z) = F(z)R(z) 
-1 

E -1 -2 Z 

= (0.58202 ^! + 0.4180z Gq =e 

= 0.5820z ? + 1.5820z~* + 2.5820z~* + 3.5820z-5 + --- 
For the unit-ramp response, the control signal U(z) is obtained as follows. Referring 
to Equations (4—51) and (4-59), 
CZ) _ FG) 
G(z) G(z) 


F(z) 27 


og GG)ü- zy 


R(z) = 
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cik} 


5 tísec) 1 2 3 4 5 t (sec) 


(a) (b) 


Figure4-40 Responses of the system designed in Example 4-13. (a) Plots of c(K) 
versus k, u(k) versus k, and u(t) versus t in the unit-step response; (b) plots of c(k) 
versus k, u(k) versus k, and u(t) versus t in the unit-ramp response. 


—-1i 
= (1.5820 — 0.58202). = 
= 1.58202! +2? +z 47-44... 


The signal u(k) becomes constant (b = 1) for k = 2. Hence, the system output will not 
exhibit intersampling ripples. Figure 4—40(b) shows plots of c(k) versus k, u(k) versus 
k, and u(t) versus t in the unit-ramp response. 

Note that the static velocity error constant K, for the present system is 


K, = lim Í Foo] 


| no FQ) 
— — 1 — el 
= sfa *Oq - us] 
0.5820z '  0.4180z ? 


=lim— 0.418022 7 0702 
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Thus, the steady-state error in the unit-ramp response is 


1 


K. = 1.4180 


Css = 


which is indicated in Figure 4—40(b). 


In the present design problem, we have required that in response to a step input 
the system exhibit the minimum settling time with no steady-state error and no 
ripples in the output after the settling time is reached. If one or more additional 
constraints are present in the design problem (tor example, if the value of the static 
velocity error constant K, is arbitrarily specified), then the number of sampling 
periods required before reaching the steady-state must be increased. For example, 
the second-order system may require three or more sampling periods before the 
steady state is reached, depending on the additional constraints imposed. See 
Example 4-14, which follows. 


Example 4-14 


Consider a design problem the same as that of Example 4-13 except that the static 
velocity error constant K, is specified. (Because of this additional constraint, the settling 
time will be longer than 2 sec.) The block diagram of the digital control system is shown 
in Figure 4-39(a). The plant transfer function G,(s) under consideration is 


1 
GG) = s(s + 1) 

The design specifications are (1) that the closed-loop system is to exhibit a finite settling 
time with zero steady-state error in the unit-step response, (2) that the output is not 
to exhibit intersampling ripples after the settling time is reached, (3) that the static 
velocity error constant K, is to be 4 sec™’, and (4) that the settling time is to be the 
minimum possible that will satisfy all these specifications. The sampling period T is 
assumed to be 1 sec. Design a digital controller Gp(z) that satisfies the given specifi- 
cations. After the controller is designed, investigate the response of the system to a 
unit-ramp input. 

The z transform of the plant that is preceded by the zero-order hold was obtained 
in Example 4-13 as 


.|i-e^ 1 
Ce) -2| s s(s+ 3l 
. 0.3679(1 + 0.7181z z^! 
 (-2z 9) - 0.367927") 
Define the closed-loop pulse transfer function as F(z): 
Cz) | G»o(2GGC) . 
R@) 1*G»(26() 


Since the first term in the expansion of G(z) is 0.36792 ', F(z) must begin with a term 
inz *: 


F(z) = az + az? ++ + anz ™ 


where N = nand nis the order of the system (thatis,n = 2in the present case). Because 
of the added constraint, we may assume N > 2. We shall try N = 3. Thus, we assume 


F(z) = a z™ + az”? + az” (4-61) 
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(If a satisfactory result is not obtained, we must assume N > 3.) Since the input is a 
step function, from Equation (4—48) we require that 


1-F(z2-(1-zN(z) (4-62) 


Note that the presence of a critically stable pole at z — 1 in the plant pulse transfer 
function G(z) requires 1 — F(z) to have a zero at z = 1. However, the function 
1 — F(z) already has a term 1 — z`" and therefore satisfies the stability requirement. 

The requirement that the static velocity error constant be 4 sec”! can be written 
as follows: 


K, = lim |: F oosa] 


Sts MENS 

=tin| a - uS 
F(1) 

"ND 4 


where we used Equation (4-50) with q = 0. Notice that from Equation (4-62) we have 
F(1) = 1. Hence, K, can be written as follows: 


1 


END 


4 (4-63) 
Since the system output should not exhibit intersampling ripples after the settling time 
is reached, we require U(z) to be of the following form: 

U(z) -betbz'tbz?^tb(z?^tz^*tz?54.-.) 


Because the plant transfer function G,(s) involves an integrator, b must be zero. 
Consequently, we have 


U(z) = bo + biz ! + bz? 
Also, from Figure 4—39(b), U(z) can be given by 
CO CG)RG) _ RO) 
GG) T RG) GE) * Gq) 


1 — 0.3679z ^! 
0.3679(1 + 0.7181z )z ^! 


U(z) = 


= F(z) 


For U(z) to be a series in z ' with three terms, F(z) must be of the following form: 


F(z) = (1 + 0.7181z )z ' F(z) (4-64) 
where F(z) is a first-degree polynomial in z~'. Then U(z) can be written as follows: 
U(z) = 2.7181(1 — 0.3679z ')Fi(z) (4-65) 


From Equations (4—61) and (4-62), we have 
1-F(2-71-az'-az^-az^-(u0-zN(2) 


If we divide 1 — aiz^! — az ^ — az ? by 1 — z ', the quotient is 1 + (1 — aj)z ^ + 
(1— a, — a;)z ? and the remainder is (1 — a; — à; — a3)z ?. Hence, N(z) is deter- 
mined as 


N(z2-51-*(1-a)z'*(1-a—-a)z^ (4-66) 
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and the remainder must be zero, so that 
1-4,—-a4—a4-0 (4-67) 


Note that from Equation (4-63) we require N(1) = 1. Therefore, by substituting 
z !-]into Equation (4-66), we obtain 


2a, + à; = 2.75 (4-68) 
Also, Equation (4-64) can be rewritten as 
F(z) = ayz7' + az? + a3z™° = (1 + 0.71812 )z  R(z) 
Hence, 
a + az + a3z7? = (1 + 0.71812 )R(z) 


Division of the left-hand side of this last equation by 1 + 0.71812 ^! yields the quotient 
[a, + (az — 0.7181a,)z~'] and the remainder [as — 0.7181(a2 — 0.7181a:)]z ^. By 
equating the quotient with A(z) and the remainder with zero, we obtain 


F(z) = a + (a; - 0.71812)! 
and 

às — 0.7181(a; — 0.7181a,) = 0 (4-69) 
Solving Equations (4-67), (4-68), and (4—69) for ai, a2, and as gives 

a, = 1.26184, a, = 0.22633, a3 = —0.48816 
Thus, F(z) is determined as 
F(z) = 1.26184z~' + 0.22633z ? — 0.48816z~* 

and 

F(z) = 1.26184 — 0.67979z! 
Equation (4—66) gives 

N(z) = 1 — 0.26184z ! — 0.48817z ? 


The digital controller pulse transfer function Gp(z) is then determined from Equa- 
tion (4—50) as follows: 
F(z) 

G(z) - z N(z) 
> (1 + 0.7181z7')z~1(1.26184 — 0.67980z~*) 
~ =1\,-1 

0.3679(1 + 071817 )2 .(1.. ,-(1 — 0.261842~? — 0.488172~?) 

(1 — z~*)(1 — 0.3679z~") 
(1 — 0.5387z ')(1 — 0.36792 ) 
(1 — 0.8418z ^ )(1 + 0.579927) 


With the digital controller thus designed, the system output in response to a 
unit-step input r(t) = 1 is obtained as follows: 


C(z) = F(z)R(z) 


Gp(z) = 


= 3.4298 


1 
1-2! 


= 1.261827! + 1.48802 ? + z ^t z +- 


= (1.261842! + 0.22633z ? — 0.488162 ?) 


Sec. 4-7 Analytical Design Method 255 


Hence, 
c(0) — 0 
c(1) = 1.2618 
c(2) = 1.4882 


ck)*1  k-23,,5,... 


The unit-step response sequence has a maximum overshoot of approximately 50%. The 
settling time is 3 sec. 
Notice that from Equation (4—65) we have 


U(z) = 2.7181(1 — 0.36792 (1.26184 — 0.679792) 
= 3.4298 — 3.1096z^! + 0.6798z ^ 


Thus, the control signal u(k) becomes zero for k = 3. Consequently, there are no 
intersampling ripples in the response. Figure 4—41 shows plots of c(k) versus k, u(k) 
versus k, and u(t) versus t in the unit-step response. Notice that the assumption of 
N = 3, that is, the assumption of F(z) as given by Equation (4—61), is satisfactory. 


cik} 


t (sec) Figure 4-41 Plots of c(K) versus k, 
u(k) versus k, and u(t) versus t in the 
unit-step response of the system de- 
signed in Example 4-14. 


256 Design of Discrete-Time Control Systems by Conventional Methods Chap. 4 


Next, let us investigate the response of this system to a unit-ramp input: 
C(z) = F(z)R() 


-1 
= (1.261847! + 0.226332? — 0.488162 *) mra 
= 1.2618z ? + 2.7500z ? + 3.7500z + --- 
In the unit-ramp response, the control signal U(z) is obtained as follows: 
C(z) _ F(z) Gz F(z) 1 22 
G(z) G(z) G(z1-z!1-z^ 


z! 
-1 


U(z) = 


= (3.4298 — 3.10962" + 0.67982 7): 


23.2987 | + 0.3202z 7+ 27 + z^ +z +. 


The signal u(k) becomes constant (b = 1) for k = 3. Hence, the system output will not 
exhibit intersampling ripples. Figure 4—42 shows plots of c(k) versus k, u(k) versus k, 
and u(t) versus t in the unit-ramp response. Notice that the steady-state error in the 
unit-ramp response is €s = 1/K, = 1, as indicated in Figure 4—42. 


Figure 4-42 Plots of c(k) versus k, 
u(k) versus k, and u(t) versus t in the 
unit-ramp response of the system 
designed in Example 4-14. 
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Comparing the digital control systems designed in Examples 4-13 and 4-14, 
we note that the latter improves the ramp response characteristics at the expense of 
the settling time. (The latter system requires one extra sampling period to reach the 
steady state.) Note also that the former has better step response characteristics, that 
is, a shorter settling time and no overshoot. Depending on the objectives of the 
system, we may choose one over the other. If good ramp response characteristics 
are required, then the system should be designed using the ramp input as the 
reference input, rather than the step input. (See Problem A-4-14.) 


EXAMPLE PROBLEMS AND SOLUTIONS 


Problem A-4-1 


Show that geometrically the patterns of the poles near z — 1 in the z plane are similar 
to the patterns of poles in the s plane near the origin. 


Solution Note that 


Near the origin of the s plane, 
zeP-] Ts c ATP +. 

or 

z—-1- Ts 
Thus, geometrical patterns of the poles near z — 1 in the z plane are similar to the 
patterns of poles in the s plane near the origin. 

Problem A-4-2 
Consider the system described by 
y(k) — 0.6y(k — 1) — 0.81y(k — 2) + 0.67y(k — 3) — 0.12y(k — 4) = x(k) 


where x(k) is the input and y(k) is the output of the system. Determine the stability 
of the system. 


Solution The pulse transfer function for the system is 


Y(z) = 1 
X(z) 1-—0.6z" —0.81z ? 0.672 ? — 0.12z ^ 


z^ 


~ z*'- 0.62) — 0.81z? + 0.67z — 0.12 
Define 
P(z) = z* — 0.62? — 0.81z? + 0.67z — 0.12 
= aoz + aiz? + azz? az + da, a > 0 
Then we have 
a =1 


a, = —0.6 
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az = —0.81 
a, = 0.67 
a, = —0.12 


The Jury stability conditions are: 


1. |a4| < ao. This condition is clearly satisfied. 
2. P(1) > 0. Since 


P(1) = 1 — 0.6 — 0.81 + 0.67 — 0.12 = 0.14 > 0 
the condition is satisfied. 
3. P(-1) > 0. Since 
P(-1) = 1 + 0.6 - 0.81 - 0.67 - 0.12 = 0 
the condition is not satisfied. P(—1) = 0 implies that there is one root at z = —1. 
4. |bs| > |bo|. Since 


RU. MERE loz 
Pee ae ay -| l^ —0.12 | 7 70-9856 
_ [aq a| ||-0.32 4 0.667| — 
bos |e @ =| 11^ 06 | = -0.5980 
the condition is satisfied. 
5. |c > |co|. Since 
_ {bs bo - | 709856 —0.5980| - 
=|, bi ^ |-0.5980 —0.9856| ~ 0-9198 
db. b; = |- 25856 05196| _ 
co= | b, 7 | -0.5980 09072| ~ 9283 


the condition is satisfied. 


From the preceding analysis, we conclude that the characteristic equation P(z) — 0 


involves a root at z — —1 and the other three roots are in the unit circle centered at 
the origin of the z plane. The system is critically stable. 
Problem A-4-3 
Consider the following characteristic equation: 
P(z) = 2° - 1.327 — 0.08z + 0.24 = 0 (4-70) 


Determine whether or not any of the roots of the characteristic equation lie outside the 
unit circle in the z plane. Use the bilinear transformation and the Routh stability 
criterion. 


Solution Let us substitute (w + 1)/(w — 1) for z in the given characteristic equation, 


resulting in 
3 2 
k z J E 13(* t 1 - 0.08% +4 + 0.24 = 0 


w-1 w-1 
Clearing the fractions by multiplying both sides of this last equation by (w — ly, we 
get 
—0.14w? + 1.064? + 5.10w + 1.98 = 0 
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By dividing both sides of this last equation by —0.14, we obtain 


w°? — 7.571w? — 36.43w — 14.14 = 0 (4-71) 
The Routh array for Equation (4-71) becomes as follows: 
one sign /, w? 1 —36.43 
change cw? — —7.571 —14.14 
w! —38.30 0 
w°  —1414 


Routh stability criterion states that the number of roots with positive real parts 
is equal to the number of changes in sign of the coefficients of the first column of the 
array. Since there is one sign change for the coefficients in the first column, there is one 
root in the right half of the w plane. This means that the original characteristic equation 
given by Equation (4-70) has one root outside the unit circle in the z plane. The system 
is unstable. (Compare the amount of computation needed in the present method and 
that needed in the Jury stability test. See in particular Example 4-6.) 


Problem A-4-4 
Consider the system defined by 
YG) _ 0.7870z ^! 
U(z) 1- 0.8195z^! + 0.60652 `? 
0.7870z 


~ z!- 0.8195 + 0.6065 


The sampling period T is 0.5 sec. Using MATLAB, plot the unit-ramp response up to 
k = 20. 


Solution The unit-ramp input u may be written as 
u — kT, k =0,1,2,... 
In the MATLAB program, this input can be given as 
k = QN; u = [T *k]; 
where N is the end of the process considered. 


A MATLAB program for plotting the unit-ramp response of the system consid- 
ered is given in MATLAB Program 4-3. The resulting plot is shown in Figure 4—43, 


Problem A-4-5 
Show that if the characteristic equation for a closed-loop system is written as 
KB(z) _ 
1+ AG) = 0 


where A(z) and B(z) do not contain K, then the breakaway and break-in points can 
be determined from the roots of 
dK X A'(z)B(z) - AG)B'(z) T 
dz B'(z) 


0 


where the primes indicate differentiation with respect to z. 
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MATLAB Program 4-3 


Yo oniinn = Unit-ramp response --------—- 


% ***** Enter the numerator and denominator of the system ***** 
num = [0 0.7870 0]; 
den = [1 -0.8195. 0.6065]; 


% ***** Enter k, unit-ramp input, filter command and plot 
96 command ***** 


k = 0:20; 
uz [0.5%k): 

y = filter(num,den,u); 

plot(k y,'o' k y,'-* k,0.5*k;'--" 


of ssx Add grid, title, xlabel, and ylabel ***** 


grid 
titlel'Unit-Ramp Response’) 
xlabelťk'] 

ylabel('y(k)") 


Unit-Ramp Response 


y(k) 
in 


Figure 4-43 Unit-ramp response of the system considered in Problem A-4-4. 
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Solution Let us write the characteristic equation as 
f(z) = A(z) + KB(z) = 0 (4-72) 
Suppose that f(z) = 0 has a multiple root of order r. Then f(z) may be written as 
f(z) = (z = 2) (2 = 22)++ (z — zp) 
If we differentiate this equation with respect to z and set z = zi, we get 


dfz) 


dz zu = 
This means that multiple roots of f(z) will satisfy the following equation: 
df(z) | 
dz —— g 
or 
d 
ae) = A'(z) + KB'(z) =0 (4-73) 
where 
dA 2e). „~ _ dB(z) 
A'G)- B'e) = 75 
Solving Equation (4-73) for K, we obtain 
_ .A'Q) 
K= -FO 


This particular value of K will yield multiple roots of the characteristic equation. If we 
substitute this value of K into Equation (4-72), we obtain 


(z) 


fle) = AG) - Fey 


B(z) =0 


or 
B'(z)A(z) - A'(z)B(z) = 0 (4-74) 


If this last equation is solved for z, the points where multiple roots occur can be 
obtained. On the other hand, from Equation (4-72) we have 


and 
dK _ A'(z)B(z) - A()B'(z) 


dz B*(z) 
If dK/dz is set equal to zero, we get the same equation as Equation (4—74). Therefore, 
the breakaway or break-in points can be simply determined from the roots of 
dK 
dz 


It should be noted that not all the solutions of Equation (4-74) or of dK/dz = 0 cor- 
respond to actual breakaway or break-in points. Such a point for which dK/dz — 0 is 


=0 
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an actual breakaway or break-in point if and only if the value of K at this point is a real, 
positive value. 


Problem A-4-6 


Discuss the procedure for designing lead compensators for digital control systems by 
the root-locus method. 


Solution We shall consider the system shown in Figure 4—44 to discuss the procedure 
for designing lead compensators. Lead compensation is useful when the system is either 
unstable for all values of gain or is stable but has undesirable transient response 
characteristics. To design lead compensators, we may use the following procedure: 


Figure 4-44 Digital control system. 


1. From the performance specifications, determine the desired location for the 
dominant closed-loop poles. 


2. By drawing the root-locus plot, ascertain whether or not the gain adjustment 
alone can yield the desired closed-loop poles. If not, calculate the angle deficiency 
$. This angle must be contributed by the lead compensator if the new root locus 
is to pass through the desired locations for the dominant closed-loop poles. 


3. Assume the lead compensator Gp(z) to be 


Gp(z) = Koa t, 0<a<1 

4. If static error constants are not specified, determine the location of the pole and 
zero of the lead compensator so that the lead compensator will contribute the 
necessary angle $. If no other requirements are imposed on the system, try to 
make the value of a as large as possible. A larger value of a generally results in 
a larger value of K,, which is desirable. (If a particular static error constant is 
specified, it is generally simpler to use the frequency-response approach.) 

5. Determine the open-loop gain of the compensated system from the magnitude 
condition. 


Once a compensator has been designed, check to see whether or not all per- 
formance specifications have been met. If the compensated system does not meet the 
performance specifications, then repeat the design procedure by adjusting the com- 
pensator pole and zero until all such specifications are met. If a large static error 
constant is required, cascade a lag network or alter the lead compensator to a lag-lead 
compensator. 


Problem A-4—7 


Draw root locus diagrams in the z plane for the system shown in Figure 4—45 for the 
following three sampling periods: T = 1 sec, T = 2 sec, and T = 4 sec. 
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Figure 4-45 Digital control system. 


Solution We first obtain the z transform of G(s). Referring to Example 3-5, we get 


.Ji-e^ K 
GG) zl s s(s + zl 
—1Xc K 
a-e oz pee] 
JK[(T-1-*e7z"*ü-e*- 1.77] 
(1—-z5)üu-e7z^)) 


Next we construct root locus diagrams for the three cases considered. 


(4-75) 


1. Sampling period T — 1: For T — 1, Equation (4—75) becomes 
K[(1-1*e')z'*(1-e'—-ez?] 
(1-zDüü-e'z) 

. 0.3679 K(z + 0.7181) 

~ (z - 1)(z — 0.3679) 
Notice that G(z) possesses a zero at z — —0.7181 and poles at z — 1 and 
z = 0.3679. The breakaway point is at z = 0.6479, and the break-in point is at 
z = —2.0841. The root-locus diagram for this case is shown in Figure 4—46(a). 


The value of gain K of any point on the root loci can be determined from the 
magnitude condition 


G(z) = 


_ | (2 - 1) — 0.3679) 
~ | 0.3679(z + 0.7181) 


If we choose a point z on the root loci, the value of K at that point can be 
calculated by substituting the value of z into this last equation. (This means that 
with this value of K that particular point becomes a closed-loop pole.) The critical 
gain is found to be K = 2.3925. 


K 


2. Sampling period T = 2: For the sampling period T = 2, we have from Equa- 


tion (4-75) 
G(z) = 1.1353K(z + 0.5232) 
Z? = tz - DG — 0.1353) 
The pulse transfer function G(z) in this case possesses a zero at z = —0.5232 and 
poles at z — 1 and z — 0.1353. The breakaway point is at z — 0.4783, and the 
break-in point is at z — —1.5247. The root-locus diagram for this case is shown 


in Figure 4—46(b). The critical gain K for stability is K = 1.4557. 
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(T = 1sec) 
(a) 
Im 
K = 1.4557 
z plane 
Unit circle 
aan m 
(b) 
Re 
—-1.5247 
"a 
Im 
z plane 
(T = 4 sec) 
(c) 


Figure 4-46 Root-locus diagrams for the system shown in Figure 4-45 when (a) 
T = 1 sec, (b) T = 2 sec, and (c) T = 4 sec. 


3. Sampling period T = 4: For the case of T = 4, Equation (4-75) gives 
3.0183K(z + 0.3010) 

(z — 1)(z — 0.0183) 

The breakaway point is at z = 0.3435, and the break-in point is at z = —0.9455. 


G(z) = 
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The root-locus diagram is shown in Figure 4—46(c). The critical gain for stability 
is K — 0.9653. 

From the three cases considered, notice that the smaller the sampling 
period is, the larger the critical gain K for stability. 


Problem A-4-8 


Consider the digital control system shown in Figure 4—47, where the plant is of the first 
order and has a dead time of 2 sec. The sampling period is assumed to be 1 sec, or T = 1. 

Design a digital PI controller such that the dominant closed-loop poles have a 
damping ratio ¢ of 0.5 and the number of samples per cycle of damped sinusoidal 
oscillation is 10. Obtain the response of the system to a unit-step input. Also, obtain 
the static velocity error constant K, and find the steady-state error in the response to 
a unit-ramp input. 


Figure 4-47 Digital control system. 


Solution The pulse transfer function of the plant that is preceded by a zero-order 
hold is 


1 — eT e7” 
GG) -z| S s+ | 


= (1-272 72 l | 


s(s * 1) 
Lorna C A A 
0-7: X"d-iNa-.z5 
0.63217? 0.6321 


~ 120.36797 ° zz — 0.3679) 


The digital PI controller has the following pulse transfer function: 


1 
Gp(z) = K, + Kini 
K, 
k, +K, 
= (K, * Ki) z-1 


The open-loop pulse transfer function becomes 


p 
(Kp + x: Ke x) 0.6321 
Go(2)G(2) = — — 1-1 —— ag 0.3679) 
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Figure 4—48 Pole and zero locations in the z plane of the system considered in 
Problem A-4-8. 


We locate the open-loop poles in the z plane as shown in Figure 4—48. There is one 
open-loop zero involved in this case, but its location is unknown at this point. 

Since it is required to have 10 samples per cycle of damped sinusoidal oscillation, 
the dominant closed-loop pole in the upper half of the z plane must lie on a line 
from the origin having an angle of 3607/10 = 36°. From Equations (4-1) and (4-2), 
rewritten as 


276 Ga 
z| = e (- a) 


25,24 
[2-20 


the desired closed-loop pole location can be determined as follows. Noting that 
Lz = 36°, we have 


2424 = 27 


w, 10 


Or @walws = 0.1. Since £ is specified as 0.5, we have 


2s x 0.5 » = 0-98 — 0.6958 


lz| = TELEL 
V1- 0.5? 10 


The closed-loop pole is located at point P in Figure 4—48, where (at point P) 


*1 
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z = 0.6958 /36° 
= 0.5629 + j0.4090 
(Note that this point is the intersection of the ¢ = 0.5 locus and the line from the origin 
having an angle of 36°.) 


If point P is to be the closed-loop pole location in the upper half of the z plane, 
then the angle deficiency at point P is 


—36° — 36° — 136.90° — 64.62° + 180° = —93.52° 


The controller zero must contribute +93.52°. This means that the zero of the digital 
controller must be located at z = 0.5881. Therefore, 


P 


K, + K; 


= 0.5881 (4-76) 


Hence, the PI controller is determined as follows: 


z — 0.5881 
Gol2) = KT 
where K = K, + K;. Gain constant K is determined from the magnitude condition: 


Kk E 0.5881 0.6321 21 
z—-1 z'(z-0.3670)!:-o5529404090 — 


or 
K = 0.5070 
Thus, 
K, + K; = 0.5070 (4-77) 
From Equations (4-76) and (4-77), we find that 
K, = 0.2982 and K; = 0.2088 
Hence, the PI controller just designed can be given by 


_ -1 
Gp(z) = 0.5070 DOM 


Finally, the open-loop pulse transfer function becomes 
1 — 0.58817! 0.6321z ? 
1-z' 1 -0.3679z7! 
., 0.3205(1 — 0.5881z )z 7 
(1—2z 9 - 0.3679z 


G»(z)G(z) = oso 


The closed-loop pulse transfer function becomes 


C(z) _ 0.3205 ? — 0.1885z74 
R(z) 1-— 1.36797! + 0.3679z ° + 0.3205z ° — 0.1885z ^ 


The response c(kT) to the unit-step input can be obtained easily by use of 
MATLAB. A MATLAB program for plotting the unit-step response is shown in 
MATLAB Program 4-4. The resulting plot is shown in Figure 4—49. 
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MATLAB Program 4—4 
Yo rem Unit-step response ---------- 


num [0 0 O 0.3205 .0.1885]; 
den = [i -1.3679 0.3679 0.3205 -0.1885]; 
r = ones(1,51); 

vz[0 50 O 1.6); 

axis(v); 

k =.0:50; 

€ = filter(num,den,r); 

plot(kc;'o') 

grid 

title("Unit-Step Response!) 
xlabel('k') 

ylabel('c(k)*) 


Unit-Step Response 


: o 
9909009? 


c(k) 


0000000000000000000000000000000000 
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Figure 4-49 Plot of c(KT) versus kT for the system designed in Problem A-4-8. 


(Sampling period T — 1 sec.) 


Problem A-4-9 


Consider the system shown in Figure 4-50. We wish to design a digital controller such 
that the dominant closed-loop poles of the system will have a damping ratio ¢ of 
0.5. We also want the number of samples per cycle of damped sinusoidal oscillation to 


be 8. Assume that the sampling period T is 0.2 sec. 


Using the root-locus method in the z plane, determine the pulse transfer function 
of the digital controller. Obtain the response of the designed system to a unit-step input. 


Also obtain the static velocity error constant K,. 
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Figure 4-50 Digital control system. 


Solution We shall first locate the desired closed-loop poles in the z plane. Referring 
to Equations (4-1) and (4-2), for a constant-damping-ratio locus we have 


jl =g T oo [ - 28 zi (4-78) 


Vi-gpge 


and 
[z= Twa = 2774 = 6 
Ws 


Since we require eight samples per cycle of damped sinusoidal oscillation, the dominant 
closed-loop pole in the upper half of the z plane must be located on a line having an 
angle of 45° and passing through the origin as shown in Figure 4-51. (Note that the 
number of samples per cycle is 3607/0. Hence, eight samples per cycle requires 0 = 
360°/8 = 45°.) Thus, 


T Wa 
= 4 7 = — = 7 — 
Vs 2 4 ? Ws 


which gives 


IE (4-79) 


20 _2n 


Ws T 03 = 1007 
Therefore, 
1 107 
Wa g^ hg T 3.9270 


By letting Z = 0.5 and substituting Equation (4-79) into Equation (4-78), we obtain 
|z| =e ^95 = 0.6354 


Hence, we can locate the desired closed-loop pole in the upper half of the z plane, as 
shown by point P in Figure 4—51. Note that at point P 


lz| /z = 0.6354 /45° = 0.4493 + j0.4493 


Next, we obtain the pulse transfer function G(z) of the plant that is preceded by 
a zero-order hold: 
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Unit circle 


Figure 4-51 Pole and zero locations for the system considered in Problem A-4-9. 


— p Ts 
GG) Z " s(s ; 5 | 
-(1-2z!) zx 
s'(s + 1) 
-1 
-a pa oro re 
. 0.01873(1 + 0.93562-')7-* — 0.01873(z + 0.9356) 
(1-27) -0.8187zz 7)  (z — D(z — 0.8187) 


We can now locate the open-loop poles and a zero on the z plane as shown in Figure 
4-51. Since point P is the location of the desired closed-loop pole, the angle deficiency 
at point P can be calculated easily as follows: 


—140.79? — 129.43? + 17.97 + 180° = —72.25° 


The controller pulse transfer function must contribute 72.25°. 
Let us choose the controller pulse transfer function to be 


zta 


z+B 


Gp(z) =K 
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and choose the zero of the controller to cancel the pole at z = 0.8187. Then the pole 
of the controller can be determined easily from the angle condition as z = 0.1595. Thus, 
we have 


1—0.8187z ! 


Gol2) = Ki— 9159577 


The open-loop pulse transfer function of the system is therefore obtained as follows: 
1 — 0.8187z ^! 0.01873(1 + 0.93562 ')z~! 
1—0.1595z' (1 — z )(1— 0.8187z ) 


_ ,,0.01873(1 + 0.9356z~")z7! 
(1— 0.159527 )(1— z~?) 


Gp(z)G(z) = K 


The gain constant K can be determined from the magnitude condition: 


0.01873(z + 0.9356) 
(z — 0.1595)(z — 1) |2=0.4493+j0.4493 


or 
K = 13.934 


Hence, we have determined the pulse transfer function of the digital controller to be 


1 — 0.818727! 
Go(z) = ses (LOIR) 


The open-loop pulse transfer function is 


0.2610(1 + 0.9356z~")z~! 


G»G)6() = G0 15052 Naz) 


The closed-loop pulse transfer function is 
C(z) — Go(z)G(z) 
R(z) 1+ Gp(z)G(z) 


0.2610z ^! + 0.2442z~? 
1 — 0.8985z ' + 0.4037z~? 


Because of the cancellation of a pole of the plant and the zero of the controller, the 
order of the system is reduced from third to second. The system has only a pair of 
conjugate complex closed-loop poles. 

Figure 4-52 shows the unit-step response sequence c(kT) versus kT. The plot 
shows the maximum overshoot to be approximately 16.5%. 

Finally, the static velocity error constant K, is determined as follows: 


= tim | E22! 026100 + 0.935627) 
iL 02 (1 — 0.15952) - z) 


z—1 


= 3.005 


272 Design of Discrete-Time Control Systems by Conventional Methods 


c(kT) 


0 0.4 0.8 1.2 1.6 2.0 2.4 
kT (sec) 
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Figure 4-52 Plot of the unit-step response sequence c(kT) versus kT for the system 


designed in Problem A-4-9. 


Problem A—4—10 


Consider the system shown in Figure 4—53. Assume that the performance specifications 
are given in terms of phase margin, gain margin, static velocity error constants, and the 
like. State procedures for designing lead compensators and lag compensators by the 


frequency-response approach. 


Solution The procedures for designing lead compensators and lag compensators may 


be stated as follows: 


LEAD COMPENSATOR 
1. Assume the following form for the lead compensator: 


1+ rw 
Gp(w) = Koltanes 0cac«1 


The open-loop transfer function of the compensated system may be written as 


1+ rw 
Koga Gm) 


TW 


Gp(w)G(w) 


tl 


_itrw 
1+ arw 


Gi(w) 


where Gi(w) = Kp G(w). Determine gain Kp to satisfy the requirement on the 


given static velocity error constant. 
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Figure 4-53 Digital control system in the w plane. 


2. Using the gain Kp thus determined, draw a Bode diagram of Gi(w), the gain- 
adjusted but uncompensated system. Evaluate the phase margin. 

3. Determine the necessary phase lead angle ¢ to be added to the system. 

4. Add 5° ~ 12? to $ to compensate for the shift of the gain crossover frequency. 
Define this added $ as ¢,,. Determine the attenuation factor a from the following 
equation: 

1-a 

lta 

5. Determine the frequency point where the magnitude of the uncompensated 
system G,(jv) is equal to —20 log (1/Va). Select this frequency as the new gain 
crossover frequency. This frequency corresponds to vm = l/( Var), and the max- 
imum phase shift m occurs at this frequency. 

6. Determine the corner frequencies of the lead compensator as follows: 


sin Ọm = 


1 
Zero of lead compensator: v = p 


Pole of lead compensator: v = E 


7. Checkthe gain margin to be sure it is satisfactory. If not, repeat the design process 
by modifying the pole-zero location of the compensator until a satisfactory result 
is obtained. 


The primary function of a lag compensator is to provide attenuation in the 
high-frequency range to give a system sufficient phase margin. The phase lag character- 
istic is of no consequence in lag compensation. 


LAG COMPENSATOR 
1. Assume the following form for the lag compensator: 


1+ tw 


Co) = KoT F gr 


(871) 


The open-loop transfer function of the compensated system may be written as 


1 
G»(w)G(w) = Ko: gn G(w) 


l-7w 
71g C00 
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where Gi(w) = Kp G(w). Determine gain Kp to satisfy the requirement on the 
given static velocity error constant. 

2. If the uncompensated system G;(w) does not satisfy the specifications on the 
phase and gain margins, then find the frequency point where the phase angle 
of the open-loop transfer function is equal to —180? plus the required phase 
margin. The required phase margin is the specified phase margin plus 5? to 12°. 
(The addition of 5? to 12? compensates for the phase lag of the lag compensator.) 
Choose this frequency as the new gain crossover frequency. 


3. To prevent detrimental effects of phase lag due to the lag compensator, the pole 
and zero of the lag compensator must be located substantially lower than the new 
gain crossover frequency. Therefore, choose the corner frequency v = 1/7 (cor- 
responding to the zero of the lag compensator) one decade below the new gain 
crossover frequency. 

4. Determine the attenuation necessary to bring the magnitude curve down to 0 dB 
at the new gain crossover frequency. Noting that this attenuation is —20 log 8, 
determine the value of B. Then the other corner frequency (corresponding to the 
pole of the lag compensator) is determined from v = 1/(8r). 


Caution. Once the lag compensator is designed in the w plane, Gp(w) must be 
transformed to the z plane lag compensator, Gp(z). Note that the locations of the pole 
and zero of the lag compensator in the z plane are close to each other. (They are near 
point z — 1.) Since the filter coefficients must be realized by binary words that use 
limited number of bits, if the number of bits employed is insufficient, the pole and zero 
locations of the filter may not be realized exactly as desired, and the resulting compen- 
sator may not behave as expected. It is important that the pole and zero of the lag 
compensator lie on a finite number of allocable discrete points. 


Problem A-4-11 


Design a digital controller for the system shown in Figure 4—54. Use the Bode diagram 
approach in the w plane. The design specifications are that the phase margin be 55°, 
the gain margin be at least 10 dB, and the static velocity error constant be 5 sec’. The 
sampling period is specified as 0.1 sec, or T = 0.1. After the controller is designed, draw 
a root-locus diagram. Locate the closed-loop poles on the diagram and find the number 
of samples per cycle of damped sinusoidal oscillation. 


Solution The z transform of the plant that is preceded by a zero-order hold is 
.l1-e^ 1. 
Ge) -z| s s(s +2 | 


1 
2aüo.nueli 
nx xs + 5 | 
1 + 0.9355z ^! 
ü — z X — 0.818777) 


z + 0.9355 
= (0-004683) c Te — 0.8187) 
Let us transform G(z) into G(w) by using the following bilinear transformation: 


_ 1 + (Tw/2) _ 1 + 0.05w 
| 1-(Tw2) 1- 0.05w 


= 0.004683z 


z 
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i 
sis +2) 


Figure 4-54 Digital control system. 


By substituting this last equation into G(z), we obtain 


o.oogsga 1+ 005v + 0.9355 
G(w) = - 
1+0.05w — M1 0.05w 
( = 0.05w G -0.05w — 0.8187) 


_ 0.5(1 + 0.001666w)(1 — 0.05w) 
T w(1 + 0.5016w) 


The Bode diagram of G( jv) is shown in Figure 4-55. 
We shall now choose the controller transfer function to be of the form 


w 

1+ rw 1-2 
Go(w) = Ko1 Y 

aTw w 

1+5 


where a = 1/r and b = 1/(a7). The open-loop transfer function is 


=, 1 + (w/a) 0.5(1 + 0.001666w)(1 — 0.05w) 
G»(w)G(w) = KoT 65) w( + 0.5016w) 


The required static velocity error constant K, is 5 sec™'. Hence, 
K, = lim [wGp(w)G(w)] = 0.5Kp = 5 
w—>0 
from which we determine that 
Kp = 10 


Using a conventional design technique, the digital controller transfer function is 
determined as 


Therefore, the open-loop transfer function becomes 


w 
1+ 1:994 |0.5(1 + 0.001666w)(1 — 0.05w) 


Gp(w)G(w) = 10 LOW wa 3 0.5016») 
12.5 
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v (rad/sec) 


Figure 4-55 Bode diagram for the system considered in Problem A-4-11. 


This open-loop transfer function gives the phase margin of approximately 55? and 
the gain margin of approximately 12.4 dB. The static velocity error constant K, is 
5 sec '. Hence, all requirements are satisfied and the designed controller transfer 
function Gp(w) is satisfactory. 

Next, we transform Gp(w) into Gp(z). The following bilinear transformation 
should be used: 


_2 22-1 zl 
Tz*1 O1z+1 ^\z+1 
Then 
20 z-1 
1+ T0047 41 
30 z-1 
12.5z +1 


z — 0.8187 1 — 0.8187! 
= azaz 08887 = ca (L- 08857) 


The open-loop pulse transfer function now becomes 


0.1987(z + 0.9355) 
(z — 0.2308)(z — 1) 


Figure 4—56 shows the root-locus diagram for the system. Using the magnitude 
condition, we find that the closed-loop poles are located at z = 0.516 + j0.388. On 


Gp(z) = 10 


Gp(z)G(z) = 
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z plane 


E 


\ 0.2308 | 0.8187 Re 


Figure 4-56 Root-locus diagram for the system designed in Problem A-4-11. 


the root-locus diagram, constant ¢ loci for ¢ = 0.5 and 0.6 are superimposed. From 
the diagram it can be seen that the damping ratio ¢ of the closed-loop poles is approx- 
imately 0.55. 

The line connecting the closed-loop pole in the upper half of the z plane and the 
origin has an angle of 37°. Hence, the number of samples per cycle of damped sinusoidal 
oscillation is 360°/37° = 9.73. 


Problem A-4-12 


Consider the digital control system shown in Figure 4-57, where the plant transfer 
function is 1/s*. Design a digital controller in the w plane such that the phase margin 
is 50° and the gain margin is at least 10 dB. The sampling period is 0.1 sec, or T = 0.1. 
After designing the controller, obtain the static velocity error constant K,. Also, obtain 
the response of the designed system to a unit-step input. 


Solution We shall first obtain the z transform of the plant that is preceded by the 


zero-order hold: 
1- -Ts l =f 
G(z) =Z s -(1-z )z|4 


a tz 
= — I) ene o MO Ac 
(1 z ) 2(1 — zy 
0.005(1 + z )z^! 0O0.005(z + 1) 
a- z`% (z - 1y 
Next, using the bilinear transformation given by 


_ 1+ (Tw2) 1-*0.05w 
1 — (Tw/2) 1-0.05w 
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Figure 4-57 Digital control system. 


we transform G(z) into G(w): 
0.005 1 + 0.005w +1 
1 — 0.05w 1 — 0.05w 
G(w) = >_> =: —— 
1 + 0.05w — 1 w 
1 — 0.05w 
Thus, 
1 — 0.05j» 
(jv) 
Figure 4-58 shows the Bode diagram of G(jv) thus obtained. Notice that the phase 
margin is — 2". It is necessary to add a lead network to give the required phase margin 


G(jv) = 


v (rad/sec) 


Figure 4-58 Bode diagram for the system considered in Problem A-4-12. 
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and gain margin. By applying a conventional design technique, it can be seen that the 
following lead network will satisfy the requirements: 


1*w w-tl 
Gol) = ^ T n6) ^ «(^ + i 


The addition of this lead network modifies the Bode diagram. The gain crossover 
frequency is shifted to v = 4. Note that the maximum phase lead 4, that this lead 
network can produce is 61.93°, since 


-1 


1 
om = sin! I7 $ = sin! 0.8824 = 61.93° 


At the gain crossover frequency v = 4, the phase angle of Gp(jv)G(jv) becomes 
—191.31? + 61.93° = —129.38°. Thus, the phase margin is 50.62°. The gain margin is 
found to be approximately 13 dB. Hence, the given design specifications are satisfied. 

We now transform the controller transfer function Gp(w) into Gp(z). By using 
the bilinear transformation 


z+1 


w= z+1 
we obtain 
z-1 
zi ) +1 
z+1 z — 0.9048 
Golz) = 4—7 — 37333 - e] 
20 + 16 


Hence, the open-loop pulse transfer function becomes 


Go(z)G(z) = sas (908 pense t n 


z -0111/ (z - 1 
i (1 — 0.1111z7')(1 — zy 


The static velocity error constant K, is obtained as follows: 


. [1— 27! 0.1867(1 — 0.9048 ')(1  z')z^? 
0.1 (1 -0.1111z7) z 


Thus, the static velocity error constant K, is infinity. There is no steady-state error in 
the ramp response. 
The closed-loop pulse transfer function of the system is 


C(z) 0.186727  0.0178z ? — 0.16892 ^ 
R(z) 1- L9244z^ + 1.2400z 7 — 0.2800 2 


Figure 4—59 shows the unit-step response. Notice that the zero of the digital controller 
at z = 0.9048 is close to the double pole at z = 1. A pole-zero pair near point z = 1 
creates a long tail with small amplitude in the response. 
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Figure 4-59 Plot of c(kT) versus kT for the system designed in Problem A-4-12. 


Problem A-4-13 


Consider the digital control system shown in Figure 4-60. The plant transfer function 
involves a transportation lag e ?*. The delay time is 5 sec, or L = 5. The desired output 
c(t) in response to a unit-step input is as shown in Figure 4—61(a). The curve rises from 
zero to the final value in 10 sec (measured from t — 5 to t — 15) and there is neither 
overshoot nor steady-state error. The settling time is 15 sec (measured from t = 0 to 
t = 15). It is required that there be no intersampling ripples in the output after the 
settling time is reached. Design a digital controller Gp(z). 


Solution Let us choose the sampling period to be 5 sec, or 7 — 5 sec. (We may, of 
course, choose the sampling period to be 2.5 sec, 1 sec, or another value. In this 
example, however, to simplify our presentation, we set the sampling period at 5 sec.) 


Digital 
controller 


Gp (z) 


Figure 4-60 Digital control system. 
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c(t) 


h[1— e 01 -5)) 


= 
—_ 
mS 


0.5 
0 1 2 3 4 5 6 k 
0 5 10 15 20 25 30 t (sec) 
(a) 
u(t) 
1.5820 
1.0 
0 5 10 15 20 25 30 t (sec) 
ib) 


Figure4-61 (a) Desired output c(t) in response to a unit-step input; (b) plot of u(r) 
versus t. 


The z transform of the plant that is preceded by the zero-order hold is 


- 1 _ e 5 e»? 
GG) -2| s 10s + | 


L4 M 1 
-2 )z ala + " 
|... 0.39352? 

~ 1 — 0.6065z^! 


Notice that there is no unstable or critically stable pole involved in G(z). Therefore, 
there is no stability problem involved in this case. 
Let us define the closed-loop pulse transfer function as F(z): 
Cz) _  G»(z)G(z) 
Ss Fi — 
RO 1+G,@G@ L0) (4-80) 


In the present case the output c(t) in the unit-step response is specified as shown in 
Figure 4-61(a). Since h[1 — e 90579] = h(1 — e^) = 1, we have A = 1.5820. from 
the deadbeat response curve shown in Figure 4—61(a), we obtain 


c(0) =0 
c(1) 2 0 
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c(2) = h(1 — e ?5) = 1.5820 x 0.3935 = 0.6225 
c(k) "1, k-23,45,.. 
from which we get 
C(z) = 0.62257? + z^ + a deg pess 


= 0.62252 ? + 274 E 


= 0.6225z ? + 0.3775z77 
1-7! 
Noting that 


1 0.6225z ? + 0.37752 2? 
C(z) = F(z)R(z) = F()i—z4 EMT ree E 


we obtain 
F(z) = 0.6225? + 0.37752? = 0.6225(1 + 0.6065z~")z~? 


Once F(z) is determined, the pulse transfer function of the digital controller can be 
obtained from Equation (4-80): 


F(z) 
G()[1 - F(z)] 
Notice that from Equation (4—48) we have 

1- F(z) = (1 ~ z7ÐN(z) 


Gp(z) = 


or 
1 — 0.62252? — 0.3775? = (1 — z)N(z) 
By dividing (1 — 0.6225z~? — 0.3775z~*) by (1 — z7'), N(z) can be determined as 


follows: 
N(z) = 1+ 27) + 0.377527? 
Consequently, 
1 — F(z) = (1 — 27"). + z7! + 0.3775z77) 
and 


0.6225(1 + 0.6065z~!)z ~? 


-—2 


1.5820(1 — 0.36782?) 
(1 — z 5 + z^! 0.3775z 7) 


Gp(z) = 


This last equation gives the pulse transfer function of the digital controller. Since c(t) 
must be unity at steady state, u(r), a continuous-time signal, must be constant after the 
steady state is reached. 

Let us determine U(z): 


CGE) _ 0.62252"? + 037152 
GG) q. py 0.393527 

(72 T 66577 
= 1.5820 + 1.582027! + z? + z? +z% ess 


U(z) = 


= -2 
- Ls [1L 836187 oon 
LS 
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Taking the inverse z transform of U(z), we find that u(K) is constant for k = 2. Thus, 
there are no intersampling ripples in the output after the settling time is reached. The 
signal u(t) versus t is plotted in Figure 4—61(b). 


Problem A—4-14 


Consider the digital control system shown in Figure 4—62. Design a digital controller 
Gp(z) such that the closed-loop system will exhibit the minimum settling time with zero 
steady-state error in a unit-ramp response. The system should not exhibit intersampling 
ripples at steady state. The sampling period T is assumed to be 1 sec. After the controller 
is designed, investigate the response of the system to a Kronecker delta input and a 
unit-step input. 
Solution The first step in the design is to determine the z transform of the plant that 
is preceded by the zero-order hold: 
1-e™1 1 
G(z) = 2| —— 5} = -23)2]/5 
(z) | s 3] ( eli 
(172! 
200 — zy 
Now define the closed-loop pulse transfer function as F(z): 
C G G 
C) CDCA . x.) 
R(z) 1+ Go(z)G(z) 


Notice that if G(z) is expanded into a series in z ^! then the first term will be 0.52 ^. 
Hence, F(z) must begin with a term in z ': 


F(z) = az + az? +- + ayz ™ 


where N z n and n is the order of the system. Since the system here is of the second 
order, n — 2. 
Since the input is a unit ramp, from Equation (4-48) we require that 


1—- F(z)-(1-z yN(z) (4-81) 


Notice that G(z) has a critically stable double pole at z = 1. Therefore, from the 
stability requirement, 1 — F(z) must have a double zero at z = 1. However, the 
function 1 — F(z) already involves a term (1 — z Y", and therefore it satisfies the 
stability requirement. 

Since the system should not exhibit intersampling ripples at steady state, we 


require U(z) to be of the following type of series in z '': 


U(z) = bo + biz ! + baz tee + byaz "t" + (ZN + £z "5 v i'"?e€..) 


Digital Zero-order 
controller hold 


Figure 4-62 Digital control system. 
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Because the plant transfer function G, (s) involves a double integrator, b must be zero. 
(Otherwise, the output increases parabolically, instead of linearly.) Consequently, we 
have 


U(z) = bo + bz Tcv bz 


From Figure 4—62 U(z) can be given by 


= €G) _ C@) RG) _ 5, RC) 
U2) = GQ) 7RG)c ^"? 
B zi 2(1 SN zy 
“FOG Sas 
=) 1+2z7 
For U(z) to be a series in z^! with a finite number of terms, F(z) must be divisible 
by 1+ 271: 
F(z) = (1 + z )R(z) (4-82) 
Then U(z) can be written as follows: 
U(z) = 2Fi(z) (4-83) 


where F(z) is a polynomial in z~’ with a finite number of terms. 
By comparing Equations (4-81) and (4-82) and by making a simple analysis, we 
see that F(z) must involve a term with at least z ?. Hence, we assume 


F(z) = az + az? + az”? 


This assumed form of F(z) involves the minimum number of terms; the transient 
response will settle in three sampling periods. 
We shall now determine constants ai, a2, and a4. From Equation (4-81), we have 


l-az!-mz?^-az?^-(»-z'!yN(z) 


If we divide the left-hand side of this last equation by (1 — z~')?, the quotient is 1 + 
(2 — a;)z~’. The remainder is [2(2 — a.) — (1 + a3)jz ? — [(2 — ai) + as]z ?. Hence, 
N(z) is determined as 


N(z)=1 + (2 - a)z™ 

and the remainder is set equal to zero: 
[2(2 — a) — (1 + a)]z™? — (2 — a, + a)z 72 = 0 

To satisfy this last equation, we require that 

2(2-a)- (1+) =0 (4-84) 

2-—a,+a,=0 (4-85) 
From Equation (4-82), we have 
àz!-az^-az?^-(l*tz EG) 


If we divide the left-hand side of this last equation by 1 + z~’, the quotient is 
z^! + (az — aj)z ?. The remainder is (a, — a) + 23)z ?. Hence, 


F(z) = az + (a; x a)z ^? 
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and the remainder is set equal to zero: 
a — 42+ a,=0 (4-86) 
By solving Equations (4-84), (4-85), and (4-86) for ai, a2, and as, we obtain 
a, = 1.25, a = 0.5, a; = —0.75 
Hence, 
N(z) = 1+ 0.7527! 
and 
F(z) = 1.252! — 0.752 ? = 1.25z ' (1 — 0.627") 
and F(z) is determined as follows: 
F(z) = 125z ! + 0.5z~? — 0.75273 
-125z (1-4 z^) - 0.627!) 
The digital controller Gp(z) is then determined from Equation (4—50): 
F(z) 
G(z)ü — z 'Y N(z) 
2. 1252 ' + z D) - 0.627") 
(1*z)z! 
20 - zy 
25 - 0.6z !) 
1+ 0.7527! 


Gp(z) = 


(1 — z^ (1 + 0.7527!) 


With the digital controller thus designed, the system output in response to a 
unit-ramp input is obtained as follows: 
C(z) = F(z)R() 
E 
= (1.25271 + 0.527? — 0.7527)  —— t 
(1.25z 0.5z 0.75z Gq =2 4j 
= 1.25277? + 3z? + 4244+ 5z5 +-+ 


Hence, 
c(0) = 0 
c(1) 2 0 
c(2) = 1.25 


c(k) "k, k=3,4,5,... 
Notice that from Equation (4-83) we have 
U(z) = 2F(z) 
= 2(1.25z7")(1 — 0.6z7’) 
= 2.527' — 1.527? 


Thus, the control signal u(k) becomes zero for k = 3. Consequently, there are no 
intersampling ripples in the response at steady state. Figure 4—63 shows plots of c(k) 
versus k, u(k) versus k, and u(t) versus t in the unit-ramp response. 


286 Design of Discrete-Time Control Systems by Conventional Methods Chap. 4 


c(k) 


Figure 4-63 Plots of c(k) versus k, 
u(k) versus k, and u(t) versus ¢ in the 
unit ramp response of the system 
designed in Problem A-4-14. 


Next, let us investigate the response of this system to a Kronecker delta input and 
a unit-step input. For a Kronecker delta input. 


C(z) = F(z)R(z) = F(z) = 125z ! + 0.5z ? — 0.752? 
Notice that U(z) in this case becomes as follows: 
R(z) _ 1.25z77(1 + z ')(1 — 0.627") 
G(z) (1 + zz "v - zy] 
-2.(1—0.62 )1—z !y 
= 2.5 — 6.527! + 5.527? — 1.5274 


U(z) = F(z) 


The control signal u(k) becomes zero for k = 4. Hence, there are no intersampling 
ripples after t = 4T = 4. 
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For the unit-step input, 


C(z) = F(z)R(z) = (125z ^! + 0.5z ? — 0.752 7) 


1 

1-z^ 
= 1.257! + 1.757? + 234244 25455: 

The maximum overshoot is 75% in the unit-step response. Notice that 

R(z) 125z (1*2) - 0.627") 


GG) | tz! Er 
2ü-z73y e) 


= 1.25(1 — 0.62-7)(2)(1 — z^!) 
= 2.5 — 4271 + 1.527? 


U(z) = F(z) 


The control signal u(k) becomes zero for k = 3. Consequently, there are no inter- 
sampling ripples after the settling time is reached. Figure 4—64(a) shows plots of c(k) 
versus k, u(k) versus k, and u(t) versus t in the response to the Kronecker delta input. 
Figure 4-64(b) shows similar plots in the unit-step response. Notice that when the 
system is designed for the ramp input the response to a step input is no longer deadbeat. 


(a) (b) 


Figure 4—64 (a) Plots of c(k) versus k, u(Kk) versus k, and u(t) versus t in the response to 
the Kronecker delta input of the system designed in Problem A—4—14; (b) plots of c(k) versus 
k, u(k) versus k, and u(t) versus t in the unit-step response of the same system. 
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PROBLEMS 


Problem B-4-1 


Consider the regions in the s plane shown in Figures 4—65(a) and (b). Draw the 
corresponding regions in the z plane. The sampling period T is assumed to be 0.3 sec. 
(The sampling frequency is w = 2z/T = 27/0.3 = 20.9 rad/sec.) 


jw 


s plane 


j7 (rad/sec) 
(al 
jw 
\ s plane 
j7 (rad/sec) 
(b) 
Figure 4-65 (a) Region in the s plane 
bounded by constant w lines and 
constant c lines; (b) region in the s 
plane bounded by constant £ lines, 
constant o lines, and a constant ø line. 
Problem B-4-2 
Consider the following characteristic equation: 
z? + 2.127 + 1.44z + 0.32 =0 
Determine whether or not any of the roots of the characteristic equation lie outside the 
unit circle centered at the origin of the z plane. 
Problem B—4—-3 
Determine the stability of the following discrete-time system: 
Y(z) | z? 
X(z 1+ 0.5271 — 1.34277 + 0.24277 
Problem B-4-4 


Consider the discrete-time closed-loop control system shown in Figure 4~13. Determine 
the range of gain K for stability by use of the Jury stability criterion. 
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Problem B-4-5 


Solve Problem B—4-4 by using the bilinear transformation coupled with the Routh 
stability criterion. 


Problem B-—4-6 
Consider the system 


Y(z) _ (z) = bo + biz | bx bz 
X(z) lctaz'te taz 


Suppose that the input sequence {x(k)} is bounded; that is, 
ix(k) = Mı = constant, k-70,12,.. 


Show that, if all poles of G(z) lie inside the unit circle in the z plane, then the output 
y(k) is also bounded; that is, 


ly(k)| s M2 = constant, k =0,1,2,... 
Problem B-4-7 


State the conditions for stability, instability, and critical stability in terms of the weight- 
ing sequence g(kT) of a linear time-invariant discrete-time control system. 


Problem B-4-8 


Consider the digital control system shown in Figure 4—66. Plot the root loci as the gain 
Kis varied from 0 to o». Determine the critical value of gain K for stability. The sampling 
period is 0.1 sec, or T = 0.1. What value of gain K will yield a damping ratio ¢ of the 
closed-loop poles equal to 0.5? With gain K set to yield ¢ = 0.5, determine the damped 
natural frequency wa and the number of samples per cycle of damped sinusoidal 


oscillation. 
Kiz * 1) 
{z - 1){z — 0.6065) 


Figure 4-66 Digital control system for Problem B-4-8. 


Problem B-—4-9 


Referring to the digital control system shown in Figure 4—67, design a digital controller 
Gp(z) such that the damping ratio ¢ of the dominant closed-loop poles is 0.5 and the 
number of samples per cycle of damped sinusoidal oscillation is 8. Assume that the 
sampling period is 0.1 sec, or T = 0.1. Determine the static velocity error constant. 
Also, determine the response of the designed system to a unit-step input. 


Problem B-4-10 


Consider the control system shown in Figure 4—68. Design a suitable digital controller 
that includes an integral control action. The design specifications are that the damping 
ratio ¢ of the dominant closed-loop poles be 0.5 and that there be at least eight samples 
per cycle of damped sinusoidal oscillation. The sampling period is assumed to be 0.2 
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Figure 4-68 Digital control system for Problem B-4-10. 


sec, or T — 0.2. After the digital controller is designed, determine the static velocity 
error constant K,. 


Problem B—4-11 


Consider the digital control system shown in Figure 4—69, where the plant is of the first 
order and has a dead time of 5 sec. By choosing a reasonable sampling period T, design 
a digital PI controller such that the dominant closed-loop poles have a damping ratio 
{of 0.5 and the number of samples per cycle of damped sinusoidal oscillation is 10. After 
the controller is designed, determine the response of the system to a unit-step input. 


Digital PI 


Riz) controller 


Figure 4-69 Digital control system for Problem B-4-11. 


Problem B—4-12 


Design a digital proportional-plus-derivative controller for the plant whose transfer 
function is 1/s?, as shown in Figure 4—70. It is desired that the damping ratio ¢ of the 
dominant closed-loop poles be 0.5 and the undamped natural frequency be 4 rad/sec. 
The sampling period is 0.1 sec, or T = 0.1. After the controller is designed, determine 
the number of samples per cycle of damped sinusoidal oscillation. 
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Figure 4-70 Digital control system for Problem B-4-12. 


Problem B—4~13 


Referring to the system considered in Problem A-4-9, redesign the digital controller 
so that the static velocity error constant K, is 12 sec !, without appreciably changing 
the locations of the dominant closed-loop poles in the z plane. The sampling period is 
assumed to be 0.2 sec, or T — 0.2. After the controller is redesigned, obtain the 
unit-step response and unit-ramp response of the digital control system. 


Problem B-4-14 


Consider the digital control system shown in Figure 4-71. Draw a Bode diagram in the 
w plane. Set the gain K so that the phase margin becomes equal to 50°. With the gain 
K so set, determine the gain margin and the static velocity error constant K,. The 
sampling period is assumed to be 0.1 sec, or T = 0.1. 


rit) 


Figure 4-71 Digital control system for Problem B-4-14. 


Problem B—-4-15 


Using the Bode diagram approach in the w plane, design a digital controller for the 
system shown in Figure 4-72. The design specifications are that the phase margin be 
50°, the gain margin be at least 10 dB, and the static velocity error constant K, be 20 
sec”', The sampling period is assumed to be 0.1 sec, or T = 0.1. After the controller 
is designed, calculate the number of samples per cycle of damped sinusoidal oscillation. 


Figure 4-72 Digital control system for Problem B-4-15. 


292 Design of Discrete-Time Control Systems by Conventional Methods Chap. 4 


Problem B-4-16 


Consider. the digital control system shown in Figure 4-73. Using the Bode diagram 
approach in the w plane, design a digital controller such that the phase margin is 60°, 
the gain margin is 12 dB or more, and the static velocity error constant is 5 sec^!. The 
sampling period is assumed to be 0.1 sec, or T = 0.1. 


EX TER: 


Figure 4-73 Digital control system for Problem B-4-16. 


Problem B—-4—17 


Consider the system shown in Figure 4—74. Design a digital controller using a Bode 
diagram in the w plane such that the phase margin is 50? and the gain margin is at least 
10 dB. It is desired that the static velocity error constant K, be 10 sec '. The sampling 
period is specified as 0.1 sec, or T' — 0.1. After the controller is designed, determine 
the number of samples per cycle of damped sinusoidal oscillation. 


K(2s + 1) 
s(s + 10.25 1) 


Figure 4-74 Digital control system for Problem B-4-17. 


Problem B-4-18 


Consider the digital control system shown in Figure 4—75. Design a digital controller 
Gp(z) such that the system output will exhibit a deadbeat response to a unit step input 
(that is, the settling time will be the minimum possible and the steady-state error will 
be zero; also, the system output will not exhibit intersampling ripples after the settling 
time is reached). The sampling period T is assumed to be 1 sec, or T — 1. 


Figure 4-75 Digital control system for Problem B-4-18. 


5 


State-Space Analysis 


5-1 INTRODUCTION 


In Chapters 3 and 4 we were concerned with conventional methods for the analysis 
and design of control systems. Conventional methods such as the root-locus and 
frequency-response methods are useful for dealing with single-input-single-output 
systems. Conventional methods are conceptually simple and require only a reason- 
able number of computations, but they are applicable only to linear time-invariant 
systems having a single input and single output. They are based on the input-output 
relationship of the system, that is, the transfer function or the pulse transfer function. 
They do not apply to nonlinear systems except in simple cases. Also, the conven- 
tional methods do not apply to the design of optimal and adaptive control systems, 
which are mostly time varying and/or nonlinear. 

A modern control system may have many inputs and many outputs, and these 
may be interrelated in a complicated manner. The state-space methods for the 
analysis and synthesis of control systems are best suited for dealing with multiple- 
input-multiple-output systems that are required to be optimal in some sense. 


Concept of the State-Space Method. The state-space method is based on the 
description of system equations in terms of n first-order difference equations or 
differential equations, which may be combined into a first-order vector-matrix dif- 
ference equation or differential equation. The use of the vector-matrix notation 
greatly simplifies the mathematical representation of the systems of equations. 

System design by use of the state-space concept enables the engineer to design 
control systems with respect to given performance indexes. In addition, design in 
the state space can be carried out for a class of inputs, instead of a specific input 
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function such as the impulse function, step function, or sinusoidal function. Also, 
state-space methods enable the engineer to include initial conditions in the design. 
This is a very convenient and useful feature that is not possible in the conventional 
design methods. 

In what follows we shall first define state, state variable, state vector, and state 
space, and then we shall present state-space equations. 


State. The state of a dynamic system is the smallest set of variables (called 
state variables) such that the knowledge of these variables at t = t, together with 
the knowledge of the input for t = t, completely determines the behavior of the 
system for any time / = fy. Note that the concept of state is by no means limited to 
physical systems. It is applicable to biological systems, economic systems, social 
systems, and others. 


State Variables. The state variables of a dynamic system are the variables 
making up the smallest set of variables that determine the state of the dynamic 
system. If at least n variables x1,x;,. .. , x, are needed to completely describe the 
behavior of a dynamic system (so that once the input is given for t = t and the initial 
state at £ = h is specified, the future state of the system is completely determined), 
then such n variables are a set of state variables. 

Note that state variables need not be physically measurable or observable 
quantities. Variables that do not represent physical quantities and those that are 
neither measurable nor observable can be chosen as state variables. Such freedom 
in choosing state variables is an advantage of the state-space methods. Practically 
speaking, however, it is convenient to choose easily measurable quantities for the 
state variables, if this is possible at all, because optimal control laws will require the 
feedback of all state variables with suitable weighting. 


State Vector. If n state variables are needed to completely describe the 
behavior of a given system, then these n state variables can be considered the n 
components of a vector x. Such a vector is called a state vector. A state vector is thus 
a vector that determines uniquely the system state x(t) for any time t = t, once the 
state at £ = ty is given and the input u(t) for t = t is specified. 


State Space. The n-dimensional space whose coordinate axes consist of the 
X; axis, x? axis, ... , x, axis is called a state space. Any state can be represented by 
a point in the state space. 


State-Space Equations. In state-space analysis we are concerned with three 
types of variables that are involved in the modeling of dynamic systems: input 
variables, output variables, and state variables. As we shall see in Section 5-2, the 
state-space representation for a given system is not unique, except that the number 
of state variables is the same for any of the different state-space representations of 
the same system. 

For time-varying (linear or nonlinear) discrete-time systems, the state equation 
may be written as 


x(k + 1)  f[x(k), u(k), k] 


and the output equation as 
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y(k) = g[x(&), u(k), k] 
For linear time-varying discrete-time systems, the state equation and output equa- 
tion may be simplified to 


x(k + 1) = G(k)x(k) + H(k)u(k) 
y(k) = C(k)x(k) + D(k)u(k) 


where 
x(k) = n-vector (state vector) 
y(k) = m-vector (output vector) 
u(k) = r-vector (input vector) 
G(k) =n X n matrix (state matrix) 
H(k) = n x r matrix (input matrix) 


C(k) =m x n matrix (output matrix) 
D(k) = m X r matrix (direct transmission matrix) 


The appearance of the variable k in the arguments of matrices G(k), H(k), 
C(K), and D(x) implies that these matrices are time varying. If the variable k does 
not appear explicitly in the matrices, they are assumed to be time invariant, or 
constant. That is, if the system is time invariant, then the last two equations can be 
simplified to 

x(k + 1) = Gx(k) + Hu(k) (5-1) 
y(k) = Cx(k) + Du(k) (5-2) 

As in the discrete-time case, continuous-time (linear or nonlinear) systems may 

be represented by the following state equation and output equation: 


x(t) = f[x(t), u(t), t] 
y(t)  g[x(t), u(t), t] 


For linear time-varying continuous-time systems, the state equation and output 
equation are given by 


x(t) = A(t)x(t) + B(r)u(t) 
y(t) = C@)x(t) + D(t)u(r) 
If the system is time invariant, then the last two equations are simplified to 
x(t) = Ax(t) + Bu(t) (5-3) 
y(t) = Cx(t) + Du(t) (5-4) 


Figure 5-1(a) shows the block diagram representation of the discrete-time control 
system defined by Equations (5-1) and (5-2), and Figure 5-1(b) shows the contin- 
uous-time control system defined by Equations (5-3) and (5-4). Notice that the basic 
configurations of the discrete-time and continuous-time systems are the same. 
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(b) 


Figure 5-1 (a) Block diagram of the linear time-invariant discrete-time control 
system represented in state space; (b) block diagram of the linear time-invariant 
continuous-time control system represented in state space. 


Note that in this book u(k) [or u(t)] denotes both the input vector to a system 
and the control vector (control input to a plant). Hence, we need to interpret u(k) 
[or u(t)] as either the input vector or the control vector depending on circumstances. 


Outline of the Chapter. Section 5-1 has introduced the state-space method 
and defined some basic terms. Section 5-2 presents various state-space representa- 
tions of linear time-invariant discrete-time systems. Section 5-3 first treats the 
solution of the linear time-invariant discrete-time state equation by the recursion 
procedure and by the z transform approach. Then it presents a method for comput- 
ing (zI — G) !. Section 5-3 concludes with discussions of the solution of the linear 
time-varying discrete-time state equation. Section 5—4 deals with the pulse transfer 
function matrix. Section 5-5 first treats the discretization of linear continuous-time 
state-space equations. Then it discusses time response between two consecutive 
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sampling instants. The final section, Section 5—6, presents Liapunov stability anal- 
ysis. It begins with discussions of the Liapunov function and definitions of stability 
of dynamic systems. Then it presents Liapunov's main stability theorem, followed 
by its applications to stability analysis of linear continuous-time systems and discrete- 
time systems. 


5-2 STATE-SPACE REPRESENTATIONS 
OF DISCRETE-TIME SYSTEMS 


Canonical Forms for Discrete-Time State-Space Equations. Many techniques 
are available for obtaining state-space representations of discrete-time systems. 
Consider the discrete-time system described by 


y(k) + ay(k — 1) + ayy(k — 2) +++ t a y(k — n) 

= bou(k) + biu(k — 1) + +++ + b,u(k — n) (5-5) 
where u(k) is the input and y(K) is the output of the system at the kth sampling 
instant. Note that some of the coefficients a; (i = 1,2,...,n) and b; (j = 0,1, 


2,...,n) may be zero. Equation (5-5) can be written in the form of the pulse transfer 
function as 


Y(z) botbz?!-:ctbz" 


U(z) l-taz!'tectaz^ ED. 


or 


Y(z) _ boz” + bz" +--+ +b, 


U(z) zt az +- +a, ocn 


There are many ways to realize state-space representations for the discrete- 
time system described by Equation (5-5), (5-6), or (5-7). Here we shall present the 
following representations: 


1. Controllable canonical form 
2. Observable canonical form 
3. Diagonal canonical form 

4. Jordan canonical form 


(For the meaning of the terms controllable and observable, see Sections 6-2 and 
6-3.) The controllable canonical form can be derived by the direct programming 
method. (See Problem A-5-1.) The observable canonical form can be obtained by 
the nested programming method. (See Problem A—5-2.) The diagonal canonical 
form and Jordan canonical form may be obtained by use of the partial-fraction- 
expansion method. (See Problems A-5-3 and A-5-4.) 


Controllable Canonical Form. The state-space representation of the discrete- 
time system given by Equation (5—5), (5-6), or (5-7) may be put in the form given 
by the following equations: 
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x(k + 1) 0 1 0 ** 0 | x(k) 0 
x(k + 1) 0 0 1 pent x(k) 0 
: =|: : : t [e[i(K) (5-8) 
Xn—i(k + 1) 0 0 0 Seve 1 Xn-1(k) 0 
x,(k + 1) Tan “ani an2 cct —a j| x(k) 1 
x(k) 
y(k) = [bn — an boibn-1 — an-1 bo: + ++ ibi — ay bo] x(k) +bou(k) (5-9) 
Xa(k) 


Equations (5-8) and (5-9) are the state equation and output equation, respectively. 
The state-space representation given by Equations (5-8) and (5-9) is commonly 
called a controllable canonical form. [For the derivation of Equations (5-8) and 
(5-9), see Problem A-5-1.] 

Note that if we reverse the order of the state variables, that is, we define new 
state variables according to the fashion 


X,(k) 0 0 +++ 0 1]f x(k) 
i(k)! [1 0 - 0 Off x(k) 
then the state equation can be written as follows: 
2 (k + 1) ZA Ta "++ Any “an ŝi (k) 1 
E£Xk + 1) 1 0 e 0 0 i| £XK) 0 
X(k-1)|-| 0 1 >’ 0 O || £k) | + | 0 |u(Kk) (5-10) 
£(k + 1) 0 0 - 1 olew] fo 
The output equation can be given by 
¥i(k) 
" : fad XX(k) 
y(k) = [b: — ai bib; — aj bo: +++ iby — an boli S | + bou(k) (5-11) 
£,(k) 


Equations (5-10) and (5-11) are also in the controllable canonical form. 


Observable Canonical Form. The state-space representation of the discrete- 
time system given by Equation (5-5), (5-6), or (5-7) may be put in the following 
form: 


x(k + 1) 0 0 0 0 -—a, | x(k) b, — a, by 
x(k + 1) 1 0> 0 0 —an || x(k) Da-1 — a, 4 bo 
: = : Pod : : + : u(k) (5-12) 
Xn (k + 1) 0. 0- 1 0 -a Xn-1(k) b; = az bo 
Xn(k + 1) 0 0 0 1 -a || x,(k) bı — aj bo 
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x(k) 
x(k) 
y(k)= [0 0 . 0 1] : + bou(k) (5-13) 
Xn-1(k) 
Xn(k) 


The state-space representation given by Equations (5-12) and (5-13) is called an 
observable canonical form. [For the derivation of Equations (5-12) and (5-13), see 
Problem A—5-2.] Notice that the n X n state matrix of the state equation given by 
Equation (5-12) is the transpose of that of the state equation defined by Equation 


Note that if we reverse the order of the state variables, that is, if we define 


P7163 0.0. 0 1 x(k) 
X2(k) = 00 >.. 10 X2(k) 
£k] [1 0 -- 0 Ol x(k) 
then the state equation and the output equation become as follows: 
Xi(k + 1) 
£k + 1) 
£,-1(k + 1) 
2,(k + 1) 
—ay, 10... 0 0 X,(k) bi — 4 bo 
—uü» 0 1 :-- 0 0 Xx(k) b; — à, bo 
=| i <a Dau] oi [e : u(k) (5-14) 
— ün-1 00> 0 1 Xn-1(k) bi — An-1 bo 
-an 0 0 --- 0 Off X,(k) b, — a, bo 
&(k) 
xk) 
yk)2[0--0 0 : + bou(k) (5-15) 
ĉn- (Kk) 
Xn(k) 


Equations (5-14) and (5-15) are also in the observable canonical form. 


Diagonal Canonical Form. If the poles of the pulse transfer function given by 
Equation (5-5), (5-6), or (5-7) are all distinct, then the state-space representation 
may be put in the diagonal canonical form as follows: 

x(k + 1) Pi O =- O |] x(k) 1 
rei dece |e uti) (5-16) 


x(k + 1) 0 0 t ps JLxs(&) i 
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x(k) 
yk) =la a e eJ 9 |+ bulk) (5-17) 
x,(k) 
[For the derivation of Equations (5-16) and (5-17), see Problem A-5-3.] 


Jordan Canonical Form. If the pulse transfer function given by Equation 
(5-5), (5-6), or (5-7) involves a multiple pole of order m atz = p; and all other poles 
are distinct, then the state equation and output equation may be given as follows: 


x(k + 1) pil 0--- 01 0 07 [ x(k) 0 
x(k +1) Op 145-010 0 | | x(k) 0 
Ge + 1 1250 0 Or mi 0 o 0 | eC) Pettey (5-18) 
Xm+1(k + 1) 000. 0 Pm <. 0] Ixsau(k) 1 
nkt | 1000-00 = pl ix J L1 
x(k) 
yk) = [er e e eJ 2) | + bout) (5-19) 
Xn(k) 


[For the derivation of Equations (5-18) and (5-19), see Problem A—5-4.] Then x n 
state matrix is in a Jordan canonical form. (For details of Jordan canonical forms, 
see Appendix A.) 
Example 5-1 
Consider the following system: 
Y(z) - z*1 
U(z) z-13z*04 


The state-space representations in the controllable canonical form, observable canon- 
ical form, and diagonal canonical form become as follows: 


CONTROLLABLE CANONICAL FORM: 
xk*n|l [0 1 [aw] fo 
ee + D] E EMI + Hr 
- x(k) 
y(k) = [1 TR 
OBSERVABLE CANONICAL FORM: 


k+] [o -o4]x609] , [1 
E + 2 = h aleo] t [iko 


k) 
k)= [p i| ^ 
y(k) = [ [209 
DIAGONAL CANONICAL FORM: 


The given pulse transfer function Y(z)/U(z) can be expanded as follows: 
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Y(z) 233 x —2/3 
U(z z+05 2+0.8 


xu(k+1]_[-05 0 [x(k 1 
Bs + J z | 0 -08l x0)! 1 1|49 

-|3 _2]] x(k) 

¥(k) = E i| 
Nonuniqueness of State-Space Representations. For a given pulse-transfer- 
function system the state-space representation is not unique. We have demonstrated 
that different state-space representations for a given pulse-transfer-function system 
are possible. The state equations, however, are related to each other by the similarity 


transformation. 
Consider the system defined by 


Hence, 


x(k + 1) = Gx(k) + Hu(k) (5-20) 
y(k) = Cx(k) + Du(k) (5-21) 

Let us define a new state vector (k) by 
x(k) = Px(k) (5-22) 


where P is a nonsingular matrix. [Note that, since both x(k) and %(k) are n-dimen- 
sional vectors, they are related to each other by a nonsingular matrix. } 
Then, by substituting Equation (5-22) into Equation (5~20), we obtain 


P&(k + 1) = GP&(k) + Hu(k) (5-23) 
Premultiplying both sides of Equation (5-23) by P^! yields 
K(k + 1) = P' GPR(k) + P^! Hu(k) (5-24) 


Let us define 
P'GP=G, P'H=f—f 


Then Equation (5-24) can be written as follows: 


&(k + 1) = Gk(k) + Hu(k) (5-25) 
Similarly, by substituting Equation (5-22) into Equation (5-21), we obtain 
y(k) = CPX(k) + Du(k) (5-26) 


By defining 


we can write Equation (5-26) as 
y(k) = Cx(k) + Bu(k) (5-27) 


We have thus shown that the state-space representation given by Equations (5-20) 
and (5-21), 
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x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) + Du(k) 
is equivalent to the state-space representation given by Equations (5-25) and (5-27), 
&(k + 1) = G&(k) + Hu(k) 
y(k) = C&(k) + Du(k) 


The state vectors x(k) and &(k) are related to each other by Equation (5-22). Since 
matrix P can be any nonsingular n X n matrix, there are infinitely many state-space 
representations for a given system. 

In some applications, we may desire to diagonalize the state matrix G. This may 
be done by properly choosing a matrix P such that 


P^! GP = diagonal matrix 


In the case where diagonalization is not possible, P^! GP may be transformed into 
a Jordan canonical form: 


P=! GP = J = Jordan canonical form 


For methods for transforming matrix G into a diagonal matrix or into a matrix in a 
Jordan canonical form, refer to Appendix A. [Note that if the partial-fraction-expan- 
sion programming method is used the state matrix becomes diagonal if all poles 
involved are distinct, and it becomes a Jordan canonical form if multiple poles are 
involved in Y(z)/U(z).] 


5-3 SOLVING DISCRETE-TIME STATE-SPACE EQUATIONS 


In this section, we first present the solution of the linear time-invariant discrete-time 
state equation 


x(k + 1) = Gx(k) + Hu(k) 


by a recursion procedure and then by the z transform method. Then we discuss 
methods for computing (zI — G) !. Finally, we treat the solution of the linear 
time-varying discrete-time state equation 


x(k + 1) = G()x(k) + H(k)u(k) 


Solution of the Linear Time-Invariant Discrete-Time State Equation. In gen- 
eral, discrete-time equations are easier to solve than differential equations because 
the former can be solved easily by means of a recursion procedure. The recursion 
procedure is quite simple and convenient for digital computations. 

Consider the following state equation and output equation: 


x(k + 1) = Gx(k) + Hu(k) (5-28) 
y(k) = Cx(k) + Du(k) (5-29) 


y". 
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The solution of Equation (5-28) for any positive integer k may be obtained directly 
by recursion, as follows: 

x(1) = Gx(0) + Hu(0) 

x(2) = Gx(1) + Hu(1) = G'x(0) + GHu(0) + Hu(1) 

x(3) = Gx(2) + Hu(2) = G’x(0) + G?Hu(0) + GHu(1) + Hu(2) 


By repeating this procedure, we obtain 
kl 
x(k) = G*x(0) + ZG-^Hu(j, k-212,3,... (5-30) 
j=0 


Clearly, x(k) consists of two parts, one representing the contribution of the initial 
state x(0) and the other the contribution of the input u(j), where j = 0,1, 
2,...,k — 1. The output y(k) is given by 

k~1 


y(k) = CG'x(0) + € È G^ Hu(j) + Du(k) (5-31) 


State Transition Matrix. Notice that it is possible to write the solution of the 
homogeneous state equation 


x(k + 1) = Gx(k) (5-32) 
as 
x(k) = W(k)x(0) (5-33) 
where W(k) is a unique n X n matrix satisfying the condition 
WV(k-c-1)- GW(k) — w(0)-I (5-34) 
Clearly, W(&) can be given by 
Wk) = G* (5-35) 


From Equation (5-33), we see that the solution of Equation (5-32) is simply a 
transformation of the initial state. Therefore, the unique matrix W(k) is called the 
State transition matrix. It is also called the fundamental matrix. The state transition 
matrix contains all the information about the free motions of the system defined by 
Equation (5-32). 

In terms of the state transition matrix W(k), Equation (5-30) can be written 
in the form 

k-1 


x(k) = W(k)x(0) + 2 Wk — j — 1)Hu(j) (5-36) 
= W(k)x(0) + > V(j)Hu(k — j — 1) (5-37) 


Substituting Equation (5-36) or Equation (5-37) into Equation (5-31), the following 
output equation can be obtained: 
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k-1 

y(k) = CW(k)x(0) + C È W(k — j — 1)Hu(j) + Du(k) (5-38) 
j-0 


k-1 


= CW(k)x(0) + C » W(j)Hu(k — j — 1) + Du(k) (5-39) 


z Transform Approach to the Solution of Discrete-Time State Equations. We 
next present the solution of a discrete-time state equation by the z transform method. 
Consider the discrete-time system described by Equation (5-28): 


x(k + 1) = Gx(k) + Hu(k) (5-40) 
Taking the z transform of both sides of Equation (5—40), we get 
zX(z) — zx(0) = GX(z) + HU(z) 
where X(z) = Z[x(k)] and U(z) = Z[u(k)]. Then 
(zI — G)X(z) = zx(0) + HU(z) 
Premultiplying both sides of this last equation by (zI — G) !, we obtain 


X(z) = (zI - G) !zx(0) + (zI - G) HU(z) (5-41) 
Taking the inverse z transform of both sides of Equation (S—41) gives 
x(k) = Z'[(zI — G) ! z]x(0) + Z '[(zI - G) ! HU(z)] (5-42) 
Comparing Equation (5-30) with Equation (5-42), we obtain 
G* = Z"(GI - G) !z] (5-43) 
and 
k-1 
> G7HB(j) = ZAI- G)! HU(z)] (5-44) 
j-0 


where k = 1,2,3,.... 

Notice that the solution by the z transform method involves the process of 
inverting the matrix (zI — G), which may be accomplished by analytical means or 
by use of a computer routine. The solution also requires the inverse z transforms 
of (zI — G) !z and (zI — G) ! HU(z). 

Example 5-2 
Obtain the state transition matrix of the following discrete-time system: 
x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) 


0 1 1 
s-| 2 4| u-|1], c=[1 0] 


Then obtain the state x(k) and the output y(k) when the input u(k) = 1 for k = 0,1, 
2,.... Assume that the initial state is given by 


o-ko] 


where 
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From Equations (5—35) and (5-43) the state transition matrix W(k) is 
Wk) = G = Z "[(z21 —- G) !z] 


Therefore, we first obtain (zI — G) *: 


-1 
(uz z -1 
GI- G) Ee z+ | 


z+1 1 
— | (z + 0.2)(z + 0.8) (z + 0.2)(z + 0.8) 
—0.16 z 


(z + 0.2)(z + 0.8) (z + 0.2)(z + 0.8) 


= 0.8 0.8 —1i 


3 3 3 3 
+ + 
z+02 z+08 z*02 2+08 

The state transition matrix W(k) is now obtained as follows: 


W(k) = G* = Z^'[(z1 - G) z] 


le 


4 z 1l z 5.2 5 Zz 
2g 32 *02 32z+0.8 324-02 32z+08 
0.8 z 0.8 z 1 z 44 z 


3:402 32408 3z+02'3z+038 


4(—0.2)* — 1(-0.8)* $(—0.2)* — 3(—0.8)* 
- (5-45) 
—98(—0.2)* + 98(—0.8)* —1(—0.2)*  $(—0.8)* 


Equation (5-45) gives the state transition matrix. 
Next, compute x(k). The z transform of x(k) is given by 


Z [x(k)] = X(z) = (zI - G) ! zx(0) + (zI - G) ! HU(z) 
= (zI - G) ![zx(0) + HU(z)] 


Since 
1 z 
UZ) =r Tq 
we obtain z g 
z z—1 z-1 
zx(0) + HU(z) = + = 
(0) (z) BM z -2 + 2z 
z-1 z-1 
Hence 


I 


X(z) = (zI - G)"[zx(0) + HU(z)] 
(z2? + 2)z 
(z + 0.2)(z + 0.8)(z — 1) 


(—z? + 1.84z)z 
(z + 0.2)(z + 0.8)(z — 1) 
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Mr Ms ds 
z+02 2+08 z-1 
Thus, the state vector x(k) is given by 


-4(-02)* + 2(-0.8* + & 


ik) SZOROS C02 ne(-ogy + & 


Finally, the output y(k) is obtained as follows: 

-2(-0.2* + 2(-0.* + 3 
1 0 
U Ol e (—0.2y¢ — (70) + A 
-3 (-0.2)* + 4(-0.8* + 8 


y(k) = Cx(k) 


il 


Computation of (z1 — G) '. The solution of the state equation given by 
Equation (5-28) by the z transform method requires the computation of (zI — G) !. 
Computing (zI — G)'! is, except in simple cases, generally a time-consuming task. 
There are both analytical and computational methods available for computing 
(zI — G). We shall present one method here. 


Method for Computing (z1 — G) '. The method presented here is based on 
the expansion of the adjoint of (zI — G). The inverse of (zI — G) can be written in 
terms of the adjoint of (zI — G), as follows: 


_ gy = adi GI- G) a 
(z1- G) eg (5-46) 
Note that the determinant |zI — G| may be written as follows: 
l1-G|9z"-*az"-az"?-4--a, (5-47) 


It can be shown (see Problem A-5-13) that adj (zI — G) may be given by 


adj (zi - G) = Iz"! + Hiz^? + Hoz"? +--+ + Hpi (5-48) 
where 
H,=Gtal 
H, = GH, + al 
: (5-49) 
H,,- GH,-2 + a,- I 
H, = GH,_, + 4,1 = 0 
Note that 2,45, . . . , a, are the coefficients appearing in the determinant given 


by Equation (5—47). The a,’s can also be given (see Problem A—5-13) by use of the 
trace, as follows: 
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à, = —trG 
a= =F tr GH, 
a, = —} tr GH, (5-50) 
a, = zd tr GH,., 
n 


(The trace of an n x n matrix is the sum of its diagonal elements.) 

For a higher-order determinant (n > 3), expanding the determinant |zI — G| 
into the form given by Equation (5-47) may be time consuming; in this case, using 
Equation (5-50) to compute the a;'s proves to be useful, since a,, H,, az, H3, . . . , @n—1, 
H,.; can easily be computed sequentially. 

By substituting Equation (5-49) into Equation (5-48) and substituting the 
resulting equation into Equation (5-46), we obtain the inverse of (zI — G). The 
present method is convenient for computer solution; a standard program is available. 


Example 5-3 
Determine the inverse of the matrix (zI — G), where 
01 01 0 
G-|03 -01 -02 
0 0  -03 


Also, obtain G*. 
From Equation (5-46), we have 
_ adj (zI - G) 


(1-G)' zI- Gi 


Although the determinant |zI — G| can be expanded easily, here for demonstration 
purposes let us use Equation (5-50) to compute ai, a2, and as. First, notice that 


01 01 0 
à = -trG = -tr} 0.3 -01 —0.2 |= 0.3 
0 0 —0.3 


Then, from Equation (5-49), we obtain 


01 01 0 0.3 0 0 
Hi-G-*a1I-/|03 -01 -02]4*|0 03 0 
0 0  -03 0 0 03 


0.4 01 0 
-|03 02 -02 
0 0 0 


Hence 
0.1 0.1 0 0.4 0.1 0 
a = —4trGH, = —1t1|0.33 -01 -02/|0.3 02 -02 
0 0 —0.3 || 0 0 0 


0.07 0.03 —0.02 
= —àtr|0.09 0.01 0.02] = —0.04 
0 0 0 
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By substituting the matrix H, and the value of a; just obtained into Equation (5—49), 
we get 
0.00 0.00 -0.02 
H: = GH, + æI = | 0.09 —0.00 0.02 
0 0 —0.04 


and 
0.012 0 0 
az = —} trGH, = —i tr! 0 0.012 0 = —0.012 
0 0 0.012 


Notice that 
H; = GH, - 0.0121 = 0 
The adjoint of (zI — G) can now be given by Equation (5-48), or 
adj (zI - G) = I + Hiz + H} 


100 0.4 0.1 0 0.03 0.03 -0.02 
-|0 1 Ofz7+1/0.3 02 -0.2/z +]0.09 —0.03 0.02 
0.0 1 0 0 0 0 0 —0.04 
z? + 0.4z + 0.03 0.1z + 0.03 —0.02 
= | 0.3z + 0.09 z? + 0.2z — 0.03 —0.2z + 0.02 
0 0 z^ — 0.04 
Also, 
ll-G|-z + az? + œz + a = z° + 0.32? — 0.04z — 0.012 
= (z + 0.2)(z — 0.2)(z + 0.3) 
Hence, 
_ æ — adi GI - G) 
(zI — G) “ter Toj 
z +0.1 0.1 —0.02 
(z + 0.2)(z — 0.2) (z +0.2)(z2 0.2) (z +0.2)(z — 0.2)(z + 0.3) 
0.3 z — 0.1 —0.2(z — 0.1) 
(z +0.2)(z — 0.2) (z +0.2)(z - 0.2) (z + 0.2)(z — 0.2)(z + 0.3) 
1 
0 ? z *t 0.3 


This last equation gives the inverse of (zI — G). 
Next, we shall obtain G*. From Equation (5-43), we have 


G* = Z'[(zI - G)'z] 
0.25z 0.75z —— 0.25z 0.25z 0.5z 0.1z 0.4z 


z+0.2 z-02 z+02 2-02 z2+02 2-02 2+03 
_ _9.75z E 0.75z 0.75z 0.25z 1.5z 0.1z 1.6z 


-g- 


2-02*z-02 z402'z-02 2402 z-02 z403 


z 


9 q z * 03 


Sec. 5-3 Solving Discrete-Time State-Space Equations 309 


0.25(—0.2)* + 0.75(0.2)*  —0.25(—0.2)* + 0.25(0.2)* 
= | -0.75(—0.2)* + 0.75(0.2)* — 0.75(-0.2)* + 0.25(0.2)* 
0 


0 
0.5(—0.2)* — 0.1(0.2)* — 0.4(-0.3)* 
~1.5(—0.2)* — 0.1(0.2)* + 1.6(-0.3)* (5-51) 
(-0.3)* 


Solution of Linear Time-Varying Discrete-Time State Equations. Consider the 
following linear time-varying discrete-time state equation and output equation: 


x(k + 1) = G(k)x(k) + H(k)u() (5-52) 
y(k) = C(k)x(k) + D(k)u(k) (5-53) 
The solution of Equation (5-52) may be found easily by recursion, as follows: 
x(h + 1) = G(A)x(h) + H(h)u(h) 
x(h + 2) = G(h + 1)x(h + 1) + H(h + 1)u(h + 1) 
= G(h + 1)G(h)x(h) + G(h + 1)H(h)u(A) + H(A + 1)u(h + 1) 


Let us define the state transition matrix (fundamental matrix) for the system 
defined by Equation (5-52) as W(k, h). It is a unique matrix satisfying the conditions 


Wk + 1,h) = G(k)W(k,h) — W(h,h) =1 


where k =h,h+1,h +2,.... It can be seen that the state transition matrix 
W(k,h) is given by the equation 

W(k,h) = G(k — 1)G(k — 2)--- Gh), k>h (5-54) 
Using W(k,h), the solution of Equation (5-52) becomes 


k-1 


x(k) = W(k, h)x(h) + > Wk, 7 + 1)H(j)u(j), k>h (5-55) 


Notice that the first term on the right-hand side of Equation (5-55) is the contribu- 
tion of the initial state x(A) to the current state x(k) and that the second term is the 
contribution of the input u(A), u(h + 1),...,u(k — 1). 

Equation (5-55) can be verified easily. Referring to Equation (5-54), we have 


Wk + 1,5) = G(E)G(k — 1): G(h) = G(OW(K, h) (5-56) 
If we substitute Equation (5—56) into 


x(k + 1) = W(k + 1, h)x(h) + X wk + 1,7 + DH(Ju(j) 
we obtain 
x(k + 1) = G(k)W(k, h)x(h) + 5 Wek + 1,j + 1)H(j)u(j) 


+W(k + 1k + 1)H(k)u(k) 
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- ow. xo * X we, j+ DB(Dw ] + H(k)u(k) 
= G(k)x(k) + H(k)u(k) 


Thus, we have shown that Equation (5-55) is the solution of Equation (5-52). 
Once we get the solution x(k), the output equation, Equation (5-53), becomes 
as follows: 


y(k) = C(K)W(K, h)x(h) + E tow; + DH(DJu(j) + D(k)u(&), kh 
jz 
If G(x) is nonsingular for all k values considered, so that the inverse of W(k, A) 
exists, then the inverse of W(k,h), denoted by W(h, k), is given as follows: 
V (k, h) = W(h,k) 
= [G(k — 1)G(k - 2)--- G(h)]! 
= G (h)G (h + 1)--- Gk — 1) (5-57) 
Summary on "V(k,h). | A summary on the state transition matrix W(k, h) gives 


the following: 


1. V(k,k) =I 
2. W(k,h) = G(k — 1)G(k — 2)--- G(À), kh 
3. If the inverse of W(k,h) exists, then 
Vr (Kk, h) = W(h,k) 
4. If G(k) is nonsingular for all k values considered, then 
W(k,i) = W(k,j)jW(j,i), ^ for any i,j,k 
If G(x) is singular for any value of k, then 
W(k,i) = W(k,j)W(]j,i), fork >j>i 


5-4 PULSE-TRANSFER-FUNCTION MATRIX 


A single-input-single-output discrete-time system may be modeled by a pulse trans- 
fer function. Extension of the pulse-transfer-function concept to a multiple-input- 
multiple-output discrete-time system gives us the pulse-transfer-function matrix. In 
this section we shall investigate the relationship between state-space representation 
and representation by the pulse-transfer-function matrix. 


Pulse-Transfer-Function Matrix. The state-space representation of an nth- 
order linear time-invariant discrete-time system with r inputs and m outputs can be 
given by 


x(k + 1) = Gx(k) + Hu(k) (5-58) 
y(k) = Cx(k) + Du(k) (5-59) 
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where x(k) is an n-vector, u(k) is an r-vector, y(k) is an m-vector, G is ann x n 
matrix, H isann X r matrix, Cisan m X n matrix, and Disan yn x r matrix. Taking 
the z transforms of Equations (5—58) and (5-59), we obtain 
zX(z) — zx(0) = GX(z) + HU(z) 
Y(z) = CX(z) + DU(z) 
Noting that the definition of the pulse transfer function calls for the assumption of 


zero initial conditions, here we also assume that the initial state x(0) is zero. Then 
we obtain 


X(z) = (zI - G)' ! HU(z) 
and 
Y(z) = [C(z1 - G) ! H + DJU(z) = F(z)U(z) 
where 
F(z) = CGI - G)'H+D (5-60) 
F(z) is called the pulse-transfer-function matrix. Yt is an m X r matrix. The pulse 
transfer function matrix F(z) characterizes the input-output dynamics of the given 


discrete-time system. 
Since the inverse of matrix (zI — G) can be written as 


adj (zI — G) 
|zI - G| 
the pulse-transfer-function matrix F(z) can be given by the equation 
C adj (zI — G)H 
lz1 — G| 


Clearly, the poles of F(z) are the zeros of |zI — G| = 0. This means that the 
characteristic equation of the discrete-time system is given by 


lz1- G| - 0 


G1-G)!- 


F(z) = +D 


or 
z" + az + az"? + +a 12 +4, =0 

where the coefficients a; depend on the elements of G. 
Similarity Transformation. We have shown that for the system defined by 

x(k + 1) = Gx(k) + Hu(k) 

y(k) = Cx(k) + Du(k) 

the pulse-transfer-function matrix is 
F(z) = CGI - G)'H + D 


In Section 5-2 we showed that various different state-space representations for a 
given system are related by the similarity transformation. By defining a new state 
vector x(k) by using a similarity transformation matrix P, or 


x(k) = Px(k) 
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where P is a nonsingular n X n matrix, we have 


&(k + 1) = G&(k) + Hu(k) (5-61) 
y(k) = €&(k) + Du(k) (5-62) 
where G, H, C, D and G, É, €, D are related, respectively, by 
P'GP=G 
P"UH-É 
CP = Ĉ 
D=D 


The pulse-transfer-function matrix F(z) for the system defined by Equations (5-61) 
and (5-62) is 
F(z) = Ĉ(zI - Ô) Ê + Ô 
Notice that the pulse-transfer-function matrices F(z) and F(z) are the same, since 
F(z) = €(z1 - Ĝ) Él + Ô = CPGI- P^ GP)! PH +D 

= CP(zP - GP)"'H + D = CGPP!—GPP)'H-«D 

= C(zI - G)'H + D = F(z) 
Thus, the pulse-transfer-function matrix is invariant under similarity transformation. 
That is, it does not depend on the particular state vector x(k) chosen for the system 
representation. 

The characteristic equation |zI — G| = 0 is also invariant under similarity 
transformation, since 
lzI — G| = |P"'|zI — G|[P| = |zI — P?! GP| = |zI — G| 


Thus, the eigenvalues of G are invariant under similarity transformation. 


5-5 DISCRETIZATION OF CONTINUOUS-TIME 
STATE-SPACE EQUATIONS 


In digital control of continuous-time plants, we need to convert continuous-time 
state-space equations into discrete-time state-space equations. Such conversion 
can be done by introducing fictitious samplers and fictitious holding devices into 
continuous-time systems. The error introduced by discretization may be made 
negligible by using a sufficiently small sampling period compared with the significant 
time constant of the system. 


Review of Solution of Continuous-Time State Equations. We shall first review 
the matrix exponential, e^'. The matrix exponential is defined by 


Ma T+ ASMP o e LA e n Y 


OY 
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Because of the convergence of the infinite series Yo A t*/k!, the series can 
be differentiated term by term to give 


d duo oA Akt 
cm duis 
at" = A + A't + 2! ped t 
A? t? Ak 1 pkol X 
safira Ae 2 iam Jax 
2 42 k-1 ,k-1 
ree EE A rema 


The matrix exponential has the property that 


e^t) = = e?'e As 


This can be proved as follows: 


oo REESS Ets 


ko K! Azo K! k-o — Licol(k — i)! 
d k 
= YA (rt sy g^c9 
k=0 k! 
In particular, if s = —t, then 
ehe ^ = = e ^et = eA? =I 


Thus, the inverse of e^ is e^^'. Since the inverse of e^' always exists, e^'is nonsingular. 
It is important to point out that 


g(^* Br = e^! eB! if AB = BA 
(A+B 4 e^'eP! if AB + BA 
We shall next obtain the solution of the continuous-time state equation 
X = Ax + Bu (5-63) 


where x is the state vector (n-vector), u the input vector (r-vector), A ann x n 
constant matrix, and B an n X r constant matrix. 
By writing Equation (5-63) as 


x(t) — Ax(t) = Bu(t) 
and premultiplying both sides of this last equation by e ^', we obtain 
e "[X(r) — Ax(r)] = $e x(0) = e ^! Bu(r) 
Integrating the preceding equation between 0 and ¢ gives 
e^*x(t) = x(0) + i e^ Bu(r) dr 
Or 


x(t) = e*'x(0) + Í eM) Bu(7) dT (5-64) 
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Equation (5-64) is the solution of Equation (5-63). Note that the solution of the 
state equation starting with the initial state x(fo) is 


t 
x(t) = e^t 9 x(t) + Í e^- Bu(7) dr (5-65) 
fo 


Discretization of Continuous-Time State-Space Equations. In what follows we 
shall present a procedure for discretizing continuous-time state-space equations. We 
assume that the input vector u(t) changes only at equally spaced sampling instants. 
Note that the sampling operation here is fictitious. We shall derive the discrete-time 
state equation and output equation that yield the exact values at t = KT, where 
k =0,1,2,.... 

Consider the continuous-time state equation and output equation 


X = Ax + Bu (5-66) 
y = Cx + Du (5-67) 


In the following analysis, to clarify the presentation, we use the notation KT and 
(k + 1)T instead of k and k + 1. The discrete-time representation of Equation 
(5-66) will take the form 


x((k + 1)T) = G(T)x(kT) + H(T)u(kT) (5-68) 


Note that the matrices G and H depend on the sampling period T. Once the sampling 
period T is fixed, G and H are constant matrices. 

To determine G(7) and H(T), we use Equation (5-64), the solution of Equa- 
tion (5-66). We assume that the input u(r) is sampled and fed to a zero-order hold 
so that all the components of u(t) are constant over the interval between any two 
consecutive sampling instants, or 


u(t) = u(kT), forkT St <kT+T (5-69) 
Since 
(k+1)T 
x((k + 1)T) = eME*DTy(Q) + g^C*DT i e ^'Bu(7) dr (5-70) 
0 
and 
kT 
x(KT) = e^*"x(0) + e» [ e ^'Bu(r)d7 (5-71) 
9 
multiplying Equation (5-71) by e^" and subtracting it from Equation (5-70) gives us 
(k+1)T 
x((K + 1)T) = eA? x(kT) + erene | e^ Bu(r)dr 
kT 
Since from Equation (5-69) u(t) = u(kT) for kT = t < kT + T, we may substitute 
u(t) = u(kT) = constant in this last equation. [Note that u(t) may jump at 
t = kT + T and thus u(kT + T) may be different from u(KT). Such a jump in u(7) 
atr = kT + T,theupper limit of integration, does not affect the value of the integral 


in this last equation, because the integrand does not involve impulse functions.] 
Hence, we may write 
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x((k + 1)T) = e^" x(kT) + e^t [ e^ Bu(kT) dt 


= e^ x(kT) + fen Bu(kT) dA (5-72) 

where A = T — t. If we define 
G(T) = e^" (5-73) 
H(T) = (i an) (5-74) 

then Equation (5-72) becomes 
x((k + 1)T) = G(T)x(kKT) + H(T)u(kT) (5-75) 


which is Equation (5-68). Thus, Equations (5-73) and (5-74) give the desired 
matrices G(T) and H(T). Note that G(T) and H(T) depend on the sampling period 
T. Referring to Equation (5-67), the output equation becomes 


y(kT) = Cx(kT) + Du(kT) (5-76) 


where matrices C and D are constant matrices and do not depend on the sampling 
period T. 

If matrix A is nonsingular, then H(T) given by Equation (5-74) can be simpli- 
fied to 


H(T) - ( | P ijs = A^ (e^ — DB = (e^! — NAB 


Comments 


1. In the state-space approach, notice that by assuming the input vector u(t) to 
be constant between any two consecutive sampling instants, the discrete-time 
model can be obtained simply by integrating the continuous-time state equa- 
tion over one sampling period. The discrete-time state equation given by 
Equation (5—68) is called the zero-order hold equivalent of the continuous-time 
state equation given by Equation (5-66). 

2. In general, in converting the continuous-time system equation into a discrete- 
time system equation, some sort of approximation is necessary. It is important 
to point out that Equation (5—75) involves no approximation, provided the 
input vector u(t) is constant between any two consecutive sampling instants, 
as assumed in the derivation. 

3. Notice that for T << 1, G(T) = G(0) = e*° = I. Thus, as the sampling period 
T becomes very small, G(T) approaches the identity matrix. 


Example 5-4 
Consider the continuous-time system given by 
Y(s) 1 


oe U(s) sta 
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Obtain the continuous-time state-space representation of the system. Then discretize 
the state equation and output equation and obtain the discrete-time state-space repre- 
sentation of the system. Also, obtain the pulse transfer function for the system by using 
Equation (5—60). 

The continuous-time state-space representation of the system is simply 


X--axctu 


y-x 
Now we discretize the state equation and the output equation. Referring to Equations 
(5—73) and (5—74), we have 
G(T) =e" 
T 1 EE e ?7 


H(T) - Í eda = 


Hence, the discretized version of the system equations is 
x(k + 1) = eT x(k) + Lc ah) 
y(k) = x(k) 
Referring to Equation (5—60), the pulse transfer function for this system is 
F(z) = C(zI- G)'H 
1-—e 437 irs e ^Dz? 
a a(l — e*7z7") 
This result, of course, agrees with the z transform of G(s) where it is preceded 


by a sampler and zero-order hold [that is, where the signal u(t) is sampled and fed to 
a zero-order hold before being applied to G(s)]: 


oo- ] -a - ez] : | 


s sta s(s + a) 


-(z- eT)! 


B (1 a e Tz?! 
a(1—e*7z) 
Example 5-5 


Obtain the discrete-time state and output equations and the pulse transfer function 
(when the sampling period 7 — 1) of the following continuous-time system: 


oy cd 
ee U(s) s(s + 2) 


which may be represented in state space by the equations 
Xi _ 0 1 X1 0 
= x 
y=[ al A 
The desired discrete-time state equation will have the form 


x((k  1)T) = G(T)x(kT) + H(T)u(kT) 


where matrices G(T) and H(T) are obtained from Equations (5-73) and (5-74) as 
follows: 
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G(T) = e^" = E ig re | 


T T 1 QAM 1 e?*—1 
ao- (Cea [E ze] n 
. i i= e) 
Thus, 
1 e? —1 
i(k +1)T)| |11 10-677] x(kT) Hr + c 
M + 0n] " [o er [283 | + | 2 a s u(kT) 
4 e 


The output equation becomes 
- xi(kT) 
y(KT) ~ [1 af 4D 


When the sampling period is 1 sec, or T = 1, the discrete-time state equation and the 
output equation become, respectively, 


k +1)]_[1 0.4323 lf xk) | , [02838 
Ms + >| = E SN t Rezo 


y(k) = [i af 20 | 


The pulse-transfer-function representation of this system can be obtained from Equa- 
tion (5-60), as follows: 


F(z) = CG1I- G)'H+D 


-1 
-[ yq 7 1 —0.4323 | Eel £0 


and 


z ~ 0.1353} | 0.4323 
EN 0.4323 
-p o|z-! €- DG -01353) el 
0 1 0.4323 
z — 0.1353 


- 0.2838z + 0.1485 
(z — 1)(z — 0.1353) 


_ 0.28382 ^ + 0.148527 
(1—z 5) — 0.1353z ) 


Note that the same pulse transfer function can be obtained by taking the z 
transform of G(s) when it is preceded by a sampler and zero-order hold. Assuming 
T = 1, we obtain 


|1- e” 1 L4 M2 1 
GG) -2| s s(s+ 5 -ü-z [s + 5 | 
2025 | = 


= — 7h} 95 
(loz HE s s+2 


-q -ry es 225 , 025 
ü-zi 1-z!'1-0135377 
0.28382 ! + 0.14852 ? 
(1—27)( — 0.1353z7") 
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MATLAB Approach to the Discretization of Continuous-Time State Equations. 
MATLAB has a convenient command to discretize the continuous-time state 
equation 

X = Ax + Bu 
into 
x(k + 1) = Gx(k) + Hu(k) 
The MATLAB command for discretization is 


[G,H] = c2d(A,B,T) 


where T is the sampling period of the discrete-time system. T should be specified in 
seconds. 

If good accuracy is needed in obtaining G and H, use format long. If only four 
decimal places are needed, use format short. If no format statement is included in 
the program, MATLAB will produce G and H in format short. 

Consider the following example: If the continuous-time system is given by 


sj" [as -alk em 


then, assuming the sampling period to be 0.05 sec, we obtain G and H as follows: 


A= [0 1;25 -—4] 
B = [0;1]; 
[G,H] = c2d(A,B,0.05) 


G= 


0.9709 0.0448 
—1.1212 0.7915 


Note that the state matrix G and input matrix H of the discrete-time state- 
space equation 


x(k + 1) = Gx(k) + Hu(k) 


depend on the sampling period T. For example, consider discretization of the 
continuous-time system given by Equation (5-77) with two more different sampling 
periods: T = 0.2 sec and T = 1 sec. As seen in the previous and following MATLAB 
outputs, a set of matrices G and H differs for a different sampling period T. 
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A = [0 1;-25 -4] A = [0 1;-25 —-4] 
B = [0;1]; B = [0;1]; 
[G,H] = c2d(A,B,0.2) [G,H] = c2d(A,B,1) 


G= G= 


—0.0761  —0.0293 
0.7321 0.0410 


As another example, consider the following system: 


X = Ax + Bu 
where 
0 100 0 
20.601 0 0 0 mE 
A 0 001b BF! o 
—0.4905 0 0 0 0.5 


Assuming that the sampling period T is 0.05 sec and without specifying the format, 
we get the following discrete-time state equation: 


x(k + 1) = Gx(k) + Hu(k) 


where matrices G and H can be found in the following computer output: 


[G,H] = c2d(A,B,0.05) 
G 


0 


0 
0.0500 
1.0000 
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Time Response Between Two Consecutive Sampling Instants. In a sampled 
continuous-time system the output is continuous in time. As seen in Chapters 3 and 
4, the z transform solution of the discrete-time system equation gives the output 
response only at the sampling instants. In practice, we may wish to determine the 
output between two consecutive sampling instants. There are a few methods avail- 
able for finding the response (output) between two consecutive sampling instants, 
such as the Laplace transform method and the modified z transform method (see 
Appendix B). Here we shall show that the state-space method can be easily modified 
to obtain the output between any two consecutive sampling instants. In what follows, 
we shall demonstrate this. 

Consider the time-invariant continuous-time system defined by 


X = Ax + Bu 
y = Cx + Du 


Let us assume that the input u is sampled and fed to a zero-order hold. Then 
u(t) = u(kT) for kT x r < kT + T. Referring to Equation (5—65), the solution of 
the state equation starting with the initial state x(t) is 


t 
x(t) = eM x(t) + | eM? Bu(s) dr 
to 
To obtain the response of the sampled system at t = kT + AT, where 0 < AT « T, 
we put t = kT + AT, to = kT, and u(r) = u(kT) in the solution x(t). Then 


kT+AT 
x(kT + AT) = e847 x(kT) + Í eT 4T? Bu(K T) dr 
kT 
AT 
0 


= eMTX(KT) + Í e^ Bu(kT) dà 


where A = kT + AT — 7. Let us define 


G(AT) = e^ (5-78) 
H(AT) = (i an) (5-79) 

Then we obtain 
x(kT + AT) = G(AT)x(kT) + H(AT)u(KT) (5-80) 


The output y(kT + AT) can be given by 
y(kT + AT) = Cx(kT + AT) + Du(kT) 
= CG(AT)x(kT) + [CH(AT) + D]u(kT) (5-81) 


Thus, the values of x(kT + AT) and y(kT + AT) between any two consecutive 
sampling instants can be obtained by computing G(AT) and H(AT) for various values 
of AT, where 0 < AT < T, and substituting the computed values into Equations 
(5-80) and (5-81). (Such computations can easily be programmed for digital com- 
puter calculation.) 
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Example 5-6 


Consider the system discussed in Example 5-5. Obtain the discrete-time state equation 
and the output equation at £ = kT + AT. Also, obtain the specific expressions for the 
state equation and output equation when T = 1 sec and AT = 0.5 sec. 

In Example 5-5, the matrices G(T) and H(T) were obtained as follows: 


1 a-e 
«n-[, Oo” 
1 e? -] 

H(T) - rs 2 
TEE 


To obtain the state equation and the output equation at t = kT + AT, where 
0 « AT « T, we first convert G(T) to G(AT) and H(T) to H(AT) and then substitute 
G(AT) and H(AT) into Equations (5-80) and (5—81), as follows: 


nr + | = 1 ja _ e ?^T) EA + (ar + 2 — J u(kT) 
0 3 


X2(kT + AT) e724T X2(kT) 1(1 _ e ?47) 
y(kT + AT) = [1 al 20 ED 
1 e 247 —1 
«[ 0] Nar + 2 ) u(kT) 


101 — e ?^T) 


For T = 1 and AT = 0.5 we obtain the state equation and output equation as follows: 
x(k + 0.5)| |1 0.3161 || x(k) 4 | 0.0920 u(k) 
x(k + 0.5) 0 0.3679 || x2(k) 0.3161 

xi(K) 


y(k + 0.5) = [1 oe] zo 


| + (0.0920)u(k) 


5-6 LIAPUNOV STABILITY ANALYSIS 


Liapunov stability analysis plays an important role in the stability analysis of control 
systems described by state-space equations. There are two methods of stability 
analysis due to Liapunov, called the first method and the second method; both apply 
to the determination of the stability of dynamic systems described by ordinary 
differential or difference equations. The first method consists entirely of procedures 
in which the explicit forms of the solutions of the differential equations or difference 
equations are used for the analysis. The second method, on the other hand, does 
not require the solutions of the differential or difference equations. This is the reason 
the second method is so useful in practice. 

Although there are many powerful stability criteria available for control sys- 
tems, such as the Jury stability criterion and the Routh-Hurwitz stability criteria, 
they are limited to linear time-invariant systems. The second method of Liapunov, 
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on the other hand, is not limited to linear time-invariant systems: it is applicable to 
both linear and nonlinear systems, time invariant or time varying. In particular, we 
find that the second method of Liapunov is indispensable for the stability analysis 
of nonlinear systems for which exact solutions may be unobtainable. (It is cautioned, 
however, that although the second method of Liapunov is applicable to any non- 
linear system, obtaining successful results may not be an easy task. Experience and 
imagination may be necessary to carry out the stability analysis of most nonlinear 
systems.) 

The second method of Liapunov is also called the direct method of Liapunov. 


Second Method of Liapunov. From the classical theory of mechanics, we know 
that a vibratory system is stable if its total energy is continually decreasing until an 
equilibrium state is reached. 

The second method of Liapunov is based on a generalization of this fact: If the 
system has an asymptotically stable equilibrium state, then the stored energy of the 
system displaced within a domain of attraction decays with increasing time until it 
finally assumes its minimum value at the equilibrium state. For purely mathematical 
systems, however, there is no simple way of defining an "energy function." To 
circumvent this difficulty, Liapunov introduced the Liapunov function, a fictitious 
energy function. This idea is, however, more general than that of energy and is more 
widely applicable. In fact, any scalar function satisfying the hypotheses of Liapunov's 
stability theorems (see Theorems 5-1 through 5—6) can serve as a Liapunov function. 

Before we discuss the Liapunov function further, it is necessary to define the 
positive definiteness of scalar functions. 


Positive Definiteness of Scalar Functions. A scalar function V(x) is said to be 
positive definite in a region Q (which includes the origin of the state space) if V(x) > 0 
for all nonzero states x in the region £2 and if V(0) = 0. 

A time-varying function V(x, t) is said to be positive definite in a region Q 
(which includes the origin of the state space) if it is bounded from below by a 
time-invariant positive definite function, that is, if there exists a positive definite 
function V(x) such that 


V(x,t) > V(x), for all £ = t 
V(0,1) — 0, for all t = t 


Negative Definiteness of Scalar Functions. A scalar function V(x) is said to be 
negative definite if —V(x) is positive definite. 


Positive Semidefiniteness of Scalar Functions. A scalar function V(x) is said 
to be positive semidefinite if it is positive at all states in the region N except at the 
origin and at certain other states, where it is zero. 


Negative Semidefiniteness of Scalar Functions. A scalar function V(x) is said 
to be negative semidefinite if — V(x) is positive semidefinite. 


Indefiniteness of Scalar Functions. A scalar function V(x) is said to be indef- 
inite if in the region 2 it assumes both positive and negative values, no matter how 
small the region 2 is. 
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Example 5-7 


In this example, we give several scalar functions and their classifications according to 
the foregoing definitions. Here we assume x to be a two-dimensional vector. 


1. V(x) = xi + xi positive definite 
2 
x " tf 
2. V(x) = xi + 1 vx positive definite 
3. V(x) = (x1 + xy positive semidefinite 
4. V(x) = -xi- (xı + x2)? negative definite 
5. V(x) = xix; + xi indefinite 


Liapunov Functions. ‘The Liapunov function, a scalar function, is a positive 
definite function, and it is continuous together with its first partial derivatives (with 
respect to its arguments) in the region N about the origin and has a time derivative 
that, when taken along the trajectory, is negative definite (or negative semidefinite). 
Liapunov functions involve x;,x5,...,x,, and possibly t. We denote them by 
V(xi, X2, ..., X4,t), or simply by V(x,t). If Liapunov functions do not include : 
explicitly, then we denote them by V(x, x2,...,x,), or V(x). 

Notice that V(x, t) is actually the total derivative of V(x, t) with respect to t 
along a solution of the system. Hence, V(x, t) < 0 implies that V(x, t) is a decreasing 
function of t. A Liapunov function is not unique for a given system. (For this reason, 
the second method of Liapunov is a more powerful tool than conventional energy 
considerations. Note that a system whose energy E decreases on the average but not 
necessarily at each instant is stable, but that E is not a Liapunov function.) 

Later in this section we shall show that in the second method of Liapunov the 
sign behavior of V(x, t) and that of its time derivative V(x,t) = dV(x, t)/dt give 
information about the stability of an equilibrium state without having the solution. 

Note that the simplest positive definite function is of a quadratic form: 


n n 
V(x) = 3Xqjxx, i,j =1,2,...,n 
i=1j=1 
In general, Liapunov functions may not be of a simple quadratic form. For any 
Liapunov function, however, the lowest-degree terms in V must be even. This can 
be seen as follows. If we define 
Xi 2 X2 ^ Xn-1 


=X —_— =X eva EX 
Xn í Xn * : Xn 


then in the neighborhood of the origin the lowest-degree terms alone will become 
dominant and we can write V(x) as 


V(x) = x V(£i, £», ras "Xp 1) 


If we keep the £;'s fixed, V(£1,$5, ...,Xn-1, 1) is a fixed quantity. For p odd, x can 
assume both positive and negative values near the origin, which means that V(x) is 
not positive definite. Hence, p must be even. 

In what follows, we give definitions of a system, an equilibrium state, stability, 
asymptotic stability, and instability. 
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System. The system we consider here is defined by 


X = f(x,1) (5-82) 
where x is a state vector (an n-vector) and f (x, t) is an n-vector whose elements are 
functions of x1, x2, . . . , x,, and t. (Note that we use the continuous-time system as 


a model to present basic materials on stability analysis by the second method of 
Liapunov. Then we extend the results obtained to the discrete-time system.) We 
assume that the system of Equation (5-82) has a unique solution starting at the given 
initial condition. We shall denote the solution of Equation (5-82) as (t; xo, to), 
where x = xo at £ = t; and t is the observed time. Thus, 


(to; Xo, fo) = Xo 
Equilibrium State. In the system of Equation (5-82), a state x., where 
f(x.,t)=0,  forallt (5-83) 


is called an equilibrium state of the system. If the system is linear and time invariant, 
that is, iff (x,t) = Ax, then there exists only one equilibrium state if A is nonsingular, 
and there exist infinitely many equilibrium states if A is singular. For nonlinear 
systems, there may be one or more equilibrium states. These states correspond to 
the constant solutions of the system (x = x, for all t). Determination of the equi- 
librium states does not involve the solution of the differential equation of the system, 
Equation (5-82), but only the solution of Equation (5-83). 

Any isolated equilibrium state (that is, where isolated from each other) can be 
shifted to the origin of the coordinates, orf (0, t) = 0, by a translation of coordinates. 
In this section, we shall treat the stability analysis only of such states. 


Stability in the Sense of Liapunov. In the following, we shall denote a spherical 
region of radius r about an equilibrium state x, as 


Ix xl sr 
where ||x — x,|| is called the Euclidean norm and is defined as follows: 
Ix — xel = [Gà — xu)! + (x2 — Xr)? t Qs 7 xy]? 
Let S(8) consist of all points such that 
lxo — x, = 6 
and let S(e) consist of all points such that 
l(t; Xo, to) — x. S e, for all t = t 


An equilibrium state x, of the system of Equation (5-82) is said to be stable in the 
sense of Liapunov if, corresponding to each S(e), there is an S(8) such that trajec- 
tories starting in $(8) do not leave S(e) as t increases indefinitely. The real number 
6 depends on e and, in general, also depends on ñ. If 8 does not depend on h, the 
equilibrium state is said to be uniformly stable. 

What we have stated here is that we first choose the region S(«), and for each 
S(e), there must be a region S(8) such that trajectories starting within S(8) do not 
leave S(e) as t increases indefinitely. 
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Asymptotic Stability. An equilibrium state x, of the system of Equation (5-82) 
is said to be asymptotically stable if it is stable in the sense of Liapunov and if every 
solution starting within $(8) converges, without leaving S(«), to x, as t increases 
indefinitely. 

In practice, asymptotic stability is more important than mere stability. Also, 
since asymptotic stability is a local concept, simply to establish asymptotic stability 
does not necessarily mean that the system will operate properly. Some knowledge 
of the size of the largest region of asymptotic stability is usually necessary. This 
region is called the domain of attraction. It is that part of the state space in which 
asymptotically stable trajectories originate. In other words, every trajectory origi- 
nating in the domain of attraction is asymptotically stable. 


Asymptotic Stability in the Large. If asymptotic stability holds for all states (all 
points in the state space) from which trajectories originate, the equilibrium state is 
said to be asymptotically stable in the large. That is, the equilibrium state x, of the 
system given by Equation (5—82) is said to be asymptotically stable in the large if 
it is stable and if every solution converges to x, as t increases indefinitely. Obviously, 
a necessary condition for asymptotic stability in the large is that there be only one 
equilibrium state in the whole state space. 

In control engineering problems, asymptotic stability in the large is a desirable 
feature. If the equilibrium state is not asymptotically stable in the large, then the 
problem becomes one of determining the largest region of asymptotic stability. This 
is usually very difficult. For all practical purposes, however, it is sufficient to deter- 
mine a region of asymptotic stability large enough that no disturbance will exceed it. 


Instability. An equilibrium state x, is said to be unstable if for some real 
number e > 0 and any real number ô > 0, no matter how small, there is always a 
state Xo in S(8) such that the trajectory starting at this state leaves S(e). 


Graphical Representation of Stability, Asymptotic Stability, and Instability. A 
graphical representation of the foregoing definitions will clarify their meanings. 

Let us consider the two-dimensional case. Figures 5~2(a), (b), and (c) show 
equilibrium states and typical trajectories corresponding to stability, asymptotic 


S(e) S (e) S(e) 


S(5) S(5) S(5) {A 


(a) (b) lc) 


Figure 5-2 (a) Stable equilibrium state and a representative trajectory; (b) asymp- 
totically stable equilibrium state and a representative trajectory; (c) unstable equi- 
librium state and a representative trajectory. 
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stability, and instability, respectively. In Figure 5—2(a), (b), or (c), the region S(8) 
bounds the initial state xo, and the region S(e) corresponds to the boundary for the 
trajectory starting from any initial state xo in the region S(8). 

Note that the foregoing definitions do not specify the exact region of allowable 
initial conditions. Thus, the definitions apply to the neighborhood of the equilibrium 
state, unless S(e) corresponds to the entire state plane. 

Note that in Figure 5—2(c) the trajectory leaves S(e) and therefore the equi- 
librium state is unstable. We cannot, however, say that the trajectory will go to 
infinity, since it may approach a limit cycle outside the region S(e). (If a linear 
time-invariant system is unstable, trajectories starting even near the unstable equi- 
librium state go to infinity. But in the case of nonlinear systems, this is not necessarily 
true.) 

It is important to point out that the definitions presented here are not the only 
ones defining the concepts of the stability of an equilibrium state. In fact, various 
other ways to define stability are available in the literature. For example, in conven- 
tional control theory, only systems that are asymptotically stable are called stable 
systems, and those systems that are stable in the sense of Liapunov but are not 
asymptotically stable are called unstable. Another example is BIBO stability. A 
linear time-invariant system is called bounded-input-bounded-output stable (BIBO 
stable) if the output starting from an arbitrary initial state is bounded when the input 
is bounded. It is noted, however, that in this book when the word "stability" is 
casually used, it normally means asymptotic stability in the sense of Liapunov. 


Liapunov Theorem on Asymptotic Stability. It can be shown that if a scalar 
function V(x), where x is an n-vector, is positive definite then the states x that satisfy 


V(x)-C 


where C is a positive constant, lie on a closed hypersurface in the n-dimensional state 
space, at least in the neighborhood of the origin. If V(x) — o as |x||— v, then such 
closed surfaces extend over the entire state space. The hypersurface V(x) = C, lies 
entirely inside the hypersurface V(x) = C; if C, < G. 

For a given system, if a positive definite scalar function V(x) can be found such 
that its time derivative taken along a trajectory is always negative, then as time 
increases, V(x) takes smaller and smaller values of C. As time increases, V(x) finally 
shrinks to zero, and therefore x also shrinks to zero. This implies the asymptotic 
stabiity of the origin of the state space. Liapunov’s main stability theorem, which 
is a generalization of the foregoing, provides a sufficient condition for asymptotic 
stability. This theorem may be stated as follows. 


Theorem 5-1. Suppose a system is described by 
X = f(x,1) 
where 
f(0,7) = 0, for all t 


If there exists a scalar function V(x, t) having continuous first partial derivatives and 
satisfying the conditions 


— 


Sec. 5-6 Liapunov Stability Analysis 327 


1. V(x, t) is positive definite. 
2. V(x, t) is negative definite. 


then the equilibrium state at the origin is uniformly asymptotically stable. 

If, in addition, V(x, t) — o as |x||— œ, then the equilibrium state at the origin 
is uniformly asymptotically stable in the large. (For the proof of this theorem, see 
Problem A-5-18.) 

The conditions of this theorem may be modified as follows: 


1’. V(x,t) is positive definite. 

2'. V(x,t) is negative semidefinite. 

y. V(o(t; Xo, £j), t) does not vanish identically in t = t for any f; and any x; # 0, 
where (t; xo, to) denotes the solution starting from x, at t = tọ. 


Then the origin of the system is uniformly asymptotically stable in the large. 

The equivalence of condition 2 in the theorem and the modified conditions 2' 
and 3' may be seen as follows. If V(x, t) is not negative definite but only negative 
semidefinite, then the trajectory of the representative point can become tangent to 
some particular surface V(x,t) = C. Since V(@(t; xo, to), t) does not vanish identi- 
cally in t = t for any tọ and any xo * 0, the representative point cannot remain at 
the tangent point [the point that corresponds to V(x, t) = 0] and therefore must 
move toward the origin. 


Liapunov Theorem on Stability. To prove stability (but not asymptotic sta- 
bility) of the origin of the system defined by Equation (5-82), the following theorem 
may be applied. 


Theorem 5-2. Suppose a system is described by 
x = f(x, f) 


where f(0,¢) = 0 for all t. If there exists a scalar function V(x, f) having continuous 
first partial derivatives and satisfying the conditions 


1. V(x, t) is positive definite. 
2. V(x, t) is negative semidefinite. 


then the equilibrium state at the origin is uniformly stable. 

It should be noted that the negative semidefiniteness of V(x, t) [V(x, t) = 0 
along the trajectories] means that the origin is uniformly stable but not necessarily 
uniformly asymptotically stable. Hence, in this case the system may exhibit a limit 
cycle operation. 


Instability. If an equilibrium state x = 0 of a system is unstable, then there 
exists a scalar function W(x, t) that determines the instability of the equilibrium 
state. We shall present a theorem on instability in the following. 


328 State-Space Analysis Chap. 5 


Theorem 5-3. Suppose a system is described by 


X = f(x,) 
where 
f(00 2-0, forallt =t 


If there exists a scalar function W(x, t) having continuous first partial derivatives and 
satisfying the conditions 


1. W(x, t) is positive definite in some region about the origin. 
2. W(x, t) is positive definite in the same region. 


then the equilibrium state at the origin is unstable. 


Remarks. | A few comments are in order when the Liapunov stability analysis 
is applied to nonlinear systems. 


1. In applying Liapunov stability theorems to a nonlinear system, the stability 
conditions obtained from a particular Liapunov function are sufficient condi- 
tions but are not necessary conditions. 

2. A Liapunov function for a particular system is not unique. Therefore, it is 
important to note that failure in finding a suitable Liapunov function to show 
stability or asymptotic stability or instability of the equilibrium state under 
consideration can give no information on stability. 

3. Although a particular Liapunov function may prove that the equilibrium state 
under consideration is stable or asymptotically stable in the region Q that 
includes this equilibrium state, it does not necessarily mean that the motions 
are unstable outside the region 2. 

4. For a stable or asymptotically stable equilibrium state, a Liapunov function 
with the required properties always exists. 


Stability Analysis of Linear Time-Invariant Systems. There are many ap- 
proaches to the investigation of the asymptotic stability of linear time-invariant 
systems. For example, for a continuous-time system described by the equation 

X = Ax 


it can be stated that a necessary and sufficient condition for the asymptotic stability 
of the origin of the system is that all eigenvalues of A have negative real parts, or 
that the zeros of the characteristic polynomial 


IsI — A| = s” + ais" +--+ + a,15 + a, 
have negative real parts. 
Similarly, for a discrete-time system represented by the equation 
x(k + 1) = Gx(k) 


a necessary and sufficient condition that can be stated for the asymptotic stability 
of the origin is that all eigenvalues of G be less than unity in their magnitudes, or 
that the zeros of the characteristic polynomial 
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ll-Gl-z'*az"4^--taaz-ca, 


lie within the unit circle centered at the origin of the z plane. 

Finding the eigenvalues, however, may become difficult in the case of higher- 
order systems or in the case where some of the coefficients of the characteristic 
polynomial are nonnumerical. In such a case, the Jury stability criterion or the 
Routh-Hurwitz stability criteria may be applied. The Liapunov approach, which 
provides an alternative approach to the stability analysis of linear time-invariant 
systems, is algebraic and does not require factoring of the characteristic polynomial, 
as will be seen later. It is important to note that for linear time-invariant systems the 
second method of Liapunov gives not just sufficient conditions, but the necessary 
and sufficient conditions for stability or asymptotic stability. 

In the following stability analysis of linear time-invariant systems, it is assumed 
that if an eigenvalue A; of matrix A is a complex quantity then A must have A,, the 
complex conjugate of A;, as its eigenvalue. Thus, any complex eigenvalues of A will 
appear as conjugate complex pairs. Also, in the following discussions on stability, 
we shall use the conjugate transpose expression, rather than the transpose expres- 
sion, of matrix A, since the elements of matrix A may include complex conjugates. 
The conjugate transpose of A is denoted by A*. It is a conjugate of the transpose: 


At =A" 
Liapunov Stability Analysis of Linear Time-Invariant Continuous-Time Systems. 

Consider the following linear time-invariant system: 
X = Ax (5-84) 


where x is a state vector (an n-vector) and Ais ann X n constant matrix. We assume 
that A is nonsingular. Then the only equilibrium state is the origin, x = 0. The 
stability of the equilibrium state of the linear time-invariant system can be investi- 
gated easily with the second method of Liapunov. 

For the system defined by Equation (5—84), let us choose as a possible Liapunov 
function 


V(x) = x*Px 


where P is a positive definite Hermitian matrix. (If x is a real vector, then P can be 
chosen to be a positive definite real symmetric matrix.) The time derivative of V(x) 
along any trajectory is 


V(x) = x*Px + x*Px 

= (Ax)*Px + x*PAx 
x*A*Px + x*PAx 
x*(A*P + PA)x 


Since V(x) was chosen to be positive definite, we require, for asymptotic stability, 
that V(x) be negative definite. Therefore, we require that 


V(x) = -x*Qx 
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where 
Q = -(A*P + PA) = positive definite 


Hence, for the asymptotic stability of the system of Equation (5-84), it is sufficient 
that Q be positive definite. 

For a test of positive definiteness of an n X n matrix, we apply Sylvester's 
criterion, which states that a necessary and sufficient condition for the matrix to be 
positive definite is that the determinants of all the successive principal minors of the 
matrix be positive. Consider, for example, the following n x n Hermitian matrix P 
(ifthe elements of P are all real, then the Hermitian matrix becomes a real symmetric 
matrix): 


Pu Po ^^ Pin 
P ES Pn Pn eee ra 
Pin Pos Pega Pnn 


where p;; denotes the complex conjugate of p;;. The matrix P is positive definite if 
all the successive principal minors are positive, that is, if 


pu Pr ^o^ Pin 

pu>o, {2h Pejo,  .., [Pr Pm ` Pm! sg 
Pir Pu : : 
Pin Pn "77 Dan 


Instead of first specifying a positive definite matrix P and examining whether 
or not Q is positive definite, it is convenient to specify a positive definite matrix Q 
first and then examine whether or not P determined from 


A*P + PA = -Q 


is positive definite. Note that positive definite P is a necessary and sufficient condi- 
tion. We shall summarize what we have just stated in the form of a theorem. 


Theorem 5-4. Consider the system described by 
X = Ax 


where x is a state vector (an n-vector) and A isan X n constant nonsingular matrix. 
A necessary and sufficient condition for the equilibrium state x — 0 to be asymp- 
totically stable in the large is that, given any positive definite Hermitian (or any 
positive definite real symmetric) matrix Q, there exists a positive definite Hermitian 
(or a positive definite real symmetric) matrix P such that 


A*P + PA = -Q (5-85) 


The scalar function x*Px is a Liapunov function for this system. [Note that in the 
linear system considered, if the equilibrium state (the origin) is asymptotically stable, 
then it is asymptotically stable in the large.] 


Remarks. In applying Theorem 5-4 to the stability analysis of linear time- 
invariant continuous-time systems, several important remarks may be made. 
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1. If V(x) = —x*Qx does not vanish identically along any trajectory, then Q may 
be chosen to be positive semidefinite. 


2. If an arbitrary positive definite matrix is chosen for Q [or an arbitrary positive- 
semidefinite matrix if V(x) does not vanish identically along any trajectory] and 
the matrix equation 


A*P + PA = -Q 


is solved to determine P, then the positive definiteness of P is a necessary and 
sufficient condition for the asymptotic stability of the equilibrium state x = 0. 
3. The final result does not depend on the particular Q matrix chosen so long as 
Q is positive definite (or positive semidefinite, as the case may be). 
4. To determine the elements of the P matrix, we equate the matrices A*P + PA 
and —Q element by element. This results in n(n + 1)/2 linear equations for the 
determination of the elements p;; = p; of P. If we denote the eigenvalues of 


A by Ay, A2,...,An, each repeated a number of times equal to its multiplicity 
as a root of the characteristic equation, and if for every sum of two roots 
Aj t+ ye #0 


then the elements of P are uniquely determined. (Note that for a stable matrix 
A the sum A; + A, is always nonzero.) 


5. In determining whether or not there exists a positive definite Hermitian or 
positive definite real symmetric matrix P, it is convenient to choose Q = I, 
where I is the identity matrix. Then the elements of P are determined from 


A*P + PA = - T 
and the matrix P is tested for positive definiteness. 
Example 5-8 
Determine the stability of the equilibrium state of the following system: 
Xi = =X% 7 2x2 
X3 = X7 4x; 


The system has only one equilibrium state at the origin. By choosing Q = I and 
substituting I into Equation (5-85), we have 


A*P + PA = ~I 


Noting that A is a real matrix, P must be a real symmetric matrix. This last equation 
may then be written as follows: 


-1 l|pu pre pu po|-1 -2 1 0 
+ = 5-86 
E BE pe | pa 1 -4 0 1 ( ) 
where we have noted that p21 = pi2 and made the appropriate substitution. If the matrix 


P turns out to be positive definite, then x *Px is a Liapunov function and the origin is 
asymptotically stable. 
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Equation (5-86) yields the following three equations: 
—2pu + 2px 7-1 
—2pu — Spi + pr =0 
—4pi — 8px = -1 


Solving for the p's, we obtain 


"S 

S 
Ul 

ale 


= B ed 
Pu = g Piz = -g 


Hence, 


By Sylvester’s criterion, this matrix is positive definite. Hence, we conclude that the 
origin of the system is asymptotically stable in the large. 
It is noted that a Liapunov function for this system is 
z 2| x, 
V(x) = x*Px = [x, x] 9? % 
Tæ all% 
= 4 (23x1 — 14x x; + 11x2) 
and V(x) is given by 


V(x) = -xi -x 


Liapunov Stability Analysis of Discrete-Time Systems. In what follows, we 
extend the Liapunov stability analysis presented thus far in this section to discrete- 
time systems. As in the case of continuous-time systems, asymptotic stability is the 
most important concept in the stability of equilibrium states of discrete-time systems. 

We shall now present a stability theorem for linear or nonlinear time- 
invariant discrete-time systems based on the second method of Liapunov. It is noted 
that for discrete-time systems, instead of V(x), we use the forward difference 
V(x(k + 1)T) — V(x(kT)), or 


AV(x(kT)) = V(x(k + 1)T) — V(x(kT)) (5-87) 


Theorem 5-5. Consider the discrete-time system 


x((k + 1)T) = f(x(kT)) (5-88) 
where 
X = n-vector 


f(x) = n-vector with property that f(0) = 0 
T — sampling period 
Suppose there exists a scalar function V(x) continuous in x such that 
1. V(x) > 0 for x + 0. 
2. AV(x) < 0 for x + 0, where 
AV(x(kT)) = V(x(k + 1)T) — V(x(kT)) = V(f(x(kT))) — V(x(kT)) 
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3. V(0) = 0. 


4. V(x) o as Ix|| o. 


Then the equilibrium state x = 0 is asymptotically stable in the large and V(x) is a 
Liapunov function. 
Note that in this theorem condition 2 may be replaced by 


2'. AV(x) = 0 for all x, and AV(x) does not vanish identically for any solution 
sequence {x(KT)} satisfying Equation (5—88). 


This means that AV(x) need not be negative definite if it does not vanish identically 
on any solution sequence of the difference equation. 


Liapunov Stability Analysis of Linear Time-Invariant Discrete-Time Systems. 
Consider the discrete-time system described by 


x(k + 1) = Gx(k) (5-89) 


where x is a state vector (an n-vector) and Gis ann X n constant nonsingular matrix. 
The origin x = 0is the equilibrium state. We shall investigate the stability of this state 
by use of the second method of Liapunov. 

Let us choose as a possible Liapunov function 


V(x(k)) = x*(k)Px(k) 


where P is a positive definite Hermitian (or a positive definite real symmetric) 
matrix. Then 


AV(x(k)) = V(x(k + 1)) — V(x(k)) 

x*(k + 1)Px(k + 1) — x*(k)Px(k) 
[Gx(k)]*P[Gx(k)] — x*(k)Px(k) 
= x*(k)G*PGx(k) — x*(k)Px(k) 


= x*(k)(G*PG — P)x(k) 


It 


Since V(x(k)) is chosen to be positive definite, we require, for asymptotic stability, 
that AV(x(k)) be negative definite. Therefore, 


AV(x(k)) = —x*(k)Qx(k) 
where 
Q = -(G*PG — P) = positive definite 


Hence, for the asymptotic stability of the discrete-time system of Equation (5-89), 
it is sufficient that Q be positive definite. 

As in the case of linear continuous-time systems, it is convenient to specify first 
a positive definite Hermitian (or a positive definite real symmetric) matrix Q and 
then to see whether or not the P matrix determined from 


G*PG - P= -Q 
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is positive definite. Note that a positive definite P is a necessary and sufficient 
condition. We shall summarize in a theorem what we have stated here. 


Theorem 5-6. Consider the discrete-time system 
x(k + 1) = Gx(k) 


where x is a state vector (an n-vector) andG is ann X n constant nonsingular matrix. 
A necessary and sufficient condition for the equilibrium state x = 0 to be asymptot- 
ically stable in the large is that, given any positive-definite Hermitian (or any positive 
definite real symmetric) matrix Q, there exists a positive definite Hermitian (or a 
positive definite real symmetric) matrix P such that 


G*PG - P= -Q (5-90) 


The scalar function x*Px is a Liapunov function for this system. 
If AV(x(k)) = —x*(k)Qx(k) does not vanish identically along any solution 
series, then Q may be chosen to be positive semidefinite. 


Stability of a Discrete-Time System Obtained by Discretizing a Continuous-Time 
System. — If the system is described in terms of state-space equations, the asymptotic 
stability of an equilibrium state of a discrete-time system obtained by discretizing a 
continuous-time system is equivalent to that of the original continuous-time system, 

Consider a continuous-time system 


X = Ax 
and the corresponding discrete-time system 
x((k + 1)T) = Gx(kT) 
where 
G = eA? 


If the continuous-time system is asymptotically stable, that is, if all the eigenvalues 
of the matrix A have negative real parts, then 


|G"]>0, | asn—o 


and the discretized system is also asymptotically stable. This is because if the Ai's 
are the eigenvalues of A then the e*'s are the eigenvalues of G. (Note that |e*7| < 1 
if A; T is negative.) 

It should be noted here that, if a continuous-time system having complex poles 
is discretized, then in certain exceptional cases hidden instability may occur, depend- 
ing on the choice of the sampling period T. That is, in some cases where a continuous- 
time system is not asymptotically stable, the equivalent discretized system may seem 
to be asymptotically stable if we look at the values of the output only at the sampling 
instants. This phenomenon occurs only at certain values of the sampling period T. 
If the value of Tis varied, then such hidden instability shows up as explicit instability. 
See Problem A-5-15. 


Contraction. A norm of x denoted by ||x| may be thought of as a measure of 
the length ofthe vector. There are several different definitions of a norm. Any norm, 
however, has the following properties: 
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\|x|| = 0, forx =0 
Ixi > 0, for x #0 
lx + yl] = ixl + Iyl, for all x and y 
Axi} = [AI |x}, for all x and real constant k 
A function f (x) is said to be a contraction if f(0) = 0 and 
If Gol < Ixl 


for some set of values of x + 0 and some norm. 
For discrete-time systems a norm ||x|| may be used as a Liapunov function. 
Consider the following discrete-time system: 


x(k + 1) =f(x(k)),  f(0)—0 (5-91) 


where x is an n-vector and f (x) is also an n-vector. Assume that f (x) is a contraction 
for all x and some norm. Then the origin of the system of Equation (5-91) is 
asymptotically stable in the large, and one of its Liapunov functions is 


V(x) = [xl 
This can be seen as follows. Since V(x) = ||x|| is positive definite and 


AV(x(k)) = V(f(x(k))) — V(x(k)) = IEI- lxi 
is negative definite because f (x) is a contraction for all x, we find V(x) = ||x|| is a 


Liapunov function, and by Theorem 5—5 the origin of the system is asymptotically 
stable in the large. (See Problem A-5—-20.) 


Example 5-9 


Consider the following system: 


x(kt*1)|.| 0 1 || xi(K) 
x(k + 1) -0.5 -1]| x(k) 
Determine the stability of the origin of the system. 


Let us choose Q to be I. Then, referring to Equation (5-90), the Liapunov 
stability equation becomes 


0 -—0.5 Pu pir 0 1 _ [Pu Pa|.. 1 0 T 
i -1 2 EP Ej B Pa 0 1 (5-92) 
If matrix P is found to be positive definite, then the origin x = 0 is asymptotically stable 


in the large. 
From Equation (5-92) we obtain the following three equations: 


0.25p22 = pu = -1 
0.5(—pi2 + pa)-poao^0 
Pu 7 2Pi2 = -1 


from which we get 
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| 


By applying Sylvester's criterion for the positive definiteness of matrix P, we find P is 
positive definite. Hence, the equilibrium state, the origin x = 0, is asymptotically stable 
in the large. 


Note that instead of choosing Q to be I we could choose Q to be a positive- 
semidefinite matrix, such as 
_ {0 0 
a-[ 1 


as long as AV(x) = —x*(k)Qx(k) does not vanish identically along any solution series. 
For the positive semidefinite matrix Q just given, we have 


AV(x) = —x3(k) 


For the present system, x2(k) identically zero implies that x,(k) is identically zero. 
Hence, AV(x) does not vanish identically along any solution series, except at the origin. 
Therefore, we can choose this positive semidefinite matrix Q for the determination of 
matrix P of the Liapunov stability equation. The Liapunov stability equation in this case 


becomes 
0 -0.5 pui Pai 0 1 _ pu pai = — 0 0 
1 -1 Pi2 Pz —0.5 -1 pa» po 0 1 


By solving this last equation, we obtain 


By applying the Sylvester criterion, we find P to be positive definite. Hence, we get the 
same conclusion as before: The origin is asymptotically stable in the large. 


Consequently, 


"d 
a 
[| 
wo [= 
ull? coto 


ILES 


EXAMPLE PROBLEMS AND SOLUTIONS 


Problem A-5-1 
(Direct programming method) Consider the discrete-time system defined by 
Y(z) _ boz” + biz"! +--+ +b, 
U(z) zct-az"1Ó4t---a, 
Show that a state-space representation of this system may be given by 


x(k + 1) 0 1 0 e 0 xi(k) 0 
x(k + 1) 0 0 1 e 0 x2(k) 0 
: =| : : : : : + |: Ju(k) (5-93) 
x.a(k + 1) 0 0 0 c 1[xaQ| |0 
x4(k + 1) An ana an2 c5 Gi || x(k) 1 
x(k) 


y(k) = [bn m bob, — a, ibo ibi —u bj] xx) t bo u(k) (5-94) 
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Solution The given system can be modified to 
Y(z) botbhz'tbz?^t::tbz" 
U(z2 l*az!'*az?^te taz" 
(bi — â boz ! Tt (b2 — à; bo)z ? Toc (bn — An bo)z " 
= bo + =———— i a IO 
ltaz taz" t taz" 


This last equation can be written as follows: 
Y(z) = bo U(z) 
+ (bi — (4 bz! + (b; -— à; bo)z ? Tec (bn — ln bz " 


ltaz!taz?^-c-ectaz^" Uz) (5-95) 
Let us define 
pe) = Gebr Qo eO eM ^ue) — (seg) 
Then Equation (5-95) becomes 
Y(z) = bo U(z) + Y(z) (5-97) 
Let us rewrite Equation (5—96) in the following form: 
Y(z) 
(bi — aibo)z ! + (bz — a3bo)z ? + +++ + (bn — an boz " 
U(z) 


= = Q(z) 


From this last equation the following two equations may be obtained: 
Q(z) = -a17 Q(z) — az Q(z) — ++» — az ™ Q(z) + U(2) (5-98) 
and 
Y(z) = (b ^ ai bo)z™ Q(z) + (b — aabz ?Q(z) + -+> 
+ (b, — an bo)z " Q(z) (5-99) 
Now we define the state variables as follows: 
X(z) =z "QG) 
Xxz) = z "* Q(z) 
: (5-100) 
Xn-1(z) = 2° Q(z) 
X,(z) = z Q(z) 
Then clearly we have 
zX\(z) = X2(z) 
2X(z) = X3(z) 


zXn-i(Z) = X,(Z) 
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In terms of difference equations, the preceding n — 1 equations become 


x(k + 1) = x(k) 


x(k + 1) = x3(k) (5-101) 
Xn-(k + 1) = x(k) 
By substituting Equation (5-100) into Equation (5-98), we obtain 
zX,(z) = —-aiX,(z2) - a2X,-1(z) — +++ — an Xi(z) + U(z) 
which may be transformed into a difference equation: 
Xn(k + 1) = —@yxi(k) — an-1 x(k) — +++ — aix (k) + u(k) (5-102) 


Also, Equation (5-99) can be rewritten as follows: 
Y(z) = (bı — ai bo)X,(z) + (b2 — a2bo)Xn-i(Z) + +++ (b. — a bo) Xi(z) 
By use of this last equation, Equation (5-97) can be written in the form 
YK) = (b, — a«boyx(k) + (bai — an-ı bo)xa(k) 
+ +++ + (b — a; bo)x,(k) + bou(k) (5-103) 


Combining Equations (5-101) and (5-102) results in the state equation given by 
Equation (5-93). The output equation, Equation (5-103), can be rewritten in the form 
given by Equation (5-94). 


Problem A-5-2 
(Nested programming method) Consider the pulse transfer function system defined by 


Y(z) _bo+ biz 4 + buz” 


G(z) = U(z) ltaz! tere ta,z" 


Show that a state-space representation of this system may be given as follows: 


x(k + 1) 0 0 0 0 —ü, x(k) 
x(k + 1) 1 0 0 0 -a,a|| x(k) 
xea(k 1) |0 0 10 -a |x(k) 
Xn(k + 1) 0 0 0 1 -a Xn(k) 
b, — an bo 
ba-1 — An-1 bo 
+ u(k) (5-104) 
b; — a;bg 
bi — a, bo 
x(k) 
x(k) 
y(k)=[0 0 --- O 1] : + bou(k) (5-105) 
Xn-1(k) 


x(k) 
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Solution Rewrite the pulse transfer function as follows: 
Y(z) - bo U(z) + z '[n Y(z) - bı U(z)] 


+ za, Y(z) — b3U(z)] + +++ + z "[a Y(z) - 5, U(z)] = 0 
or 


Y(z) = boU(z) + z (b U(z) — a, Y(z) + z M (b;U(z) — a: Y(z) 
+ z^ [b5U(z) — a3¥(z) + ---]) (5-106) 
Now define the state variables as follows: 
X,(z) = z7'[b, U(z) - a Y(z) + Xn-1(z)] 
Xn-1(z) = z'[b2 U(z) — @ Y¥(z) + X,-2(Z)] 
(5-107) 
Xz) = z^"! [b,-iU(z) — an-ı Y(z) + Xi(z)] 
X\(z) = z7"[b, U(z) — a. Y(z)] 
Then Equation (5-106) can be written in the form 
Y(z) = bo U(z) + X.(z) (5-108) 


By substituting Equation (5-108) into Equation (5-107) and multiplying both sides of 
the equations by z, we obtain 


zX,(z) = Xn-1(z) — a Xn(z) + (bi — aı bo) U(z) 
2X,-1(Z) = Xn-2(Z) — a2 Xn (z) + (b2 — a2 bo) U(z) 


zXXz) = Xi(z) — an-1 X (Z) + (bai — asi bo) U(Z) 
zXi(z) = —a, X.(z) + (bn — a, bo)U(z) 


Taking the inverse z transforms of the preceding n equations and writing the resulting 
equations in the reverse order, we obtain 


xi(k + 1) = —anxn(k) + (bn — a,bo)u(k) 
xo(k + 1) = x(k) — an-1Xn(k) + (Ba-1 — an-ı bo)u(k) 


Xn—-i(k + 1) = x, (Kk) — a2Xn(k) + (b2 — az bo)ulk) 
x«(k + 1) = x, (Kk) — aix(k) + (bi — a1 boju(k) 
Also, the inverse z transform of Equation (5-108) yields 
y(k) = Xn(k) + boulk) 
Rewriting the state equation and the output equation in the standard vector-matrix form 
gives Equations (5-104) and (5-105), respectively. 
Problem A-5-3 


(Partial-fraction-expansion programming method) Consider the pulse transfer func- 
tion system given by 
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Y(z) Un boz” + biz" tcc b, 
U(z2  z'-r:az"-r.--.-ca, 


Show that the state equation and output equation can be given in the following diagonal 
canonical form if all poles are distinct. 


x(k + 1) p O ce 0j x(k) 1 
"etn? Acn 9 m0 iila — (5-109) 
x(k*2l| [0 0 Pa |lxa(k)| |i 
and 
xi(k) 
39. =le c eJ 2 | + boulk) (5-110) 
x(k) 
Solution The system pulse transfer function can be modified as follows: 
Y(z) _ boz” + bız" +++: + b, 
U(z) z'"taz"t€--a, 
Lord (bi — ai bg)z" ' + (bo — asbo)z" ? + +++ + (b, — a,bo) (5-111) 


G = p)G€ - pi: G = Pr) 


Since all poles of the pulse transfer function Y(z)/U(z) are distinct, ¥(z)/U (2) can be 
expanded into the following form: 


Y(z) Ci C2 Cn 
= bo + Abe: 5-112 
Ulz) ° z-p z-p Z — ps e) 
where 
-nn YC) 
o= im FEC p) 
Equation (5-112) can be written in the form 
Cy C2 C5 
= 4e = 
Y(z) = bo U(z) + PH U(z) + gui U(z) t "xy U(z) (5-113) 
Let us define the state variables as follows: 
1 
Xi(z) = zepi U(z) 
Xz) = quis) 
e (5-114) 
X E U(z) 
Ceres 
Then Equation (5-114) can be rewritten as 
zX\(z) = py Xi(z) + U(z) 
zX(z) = pa Xx(z) + U(z) (5-115) 


zX,(z) = p. X.(z) + U(z) 
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Also, Equation (5-113) can be written as 
Y(z) = bo U(z) + e&Xi(z) + c2 X2(z) + +++ + e Xn(z) (5-116) 
The inverse z transforms of Equations (5-115) and (5-116) become 
xi(k + 1) = pixi(k) + u(k) 
x(k + 1) CUM t u(k) (5-117) 
Xn(k + 1) = p.x.(k) + u(k) 
and 
y(k) = eixi(k) + coxo(k) + +++ + cux (k) + bou(k) (5-118) 


Rewriting the state equation and the output equation in the form of vector-matrix 
equations, we obtain Equations (5-109) and (5-110). 
Problem A-5-4 


(Partial-fraction-expansion programming method) Consider the pulse transfer func- 
tion system defined by 


Y(z) = boz” t biz"! Toseem bn 
U(z) z'-az"1i:--a, 


Assume that the system involves a multiple pole of order m at z = p; and that all other 
poles are distinct. 

Show that this system may be represented by the following state equation and 
output equation: 


x(k + 1) Pil O°: 0; 0 0| f x(k) 0 
x(k + 1) Op 1- Of 0 0| | x(k) 0 
. . . z ad . 
: ME :| : 
j : : 
l 
mo mc E 9 00 llli — (s-119) 
Xmei(k + 1) 0 0 0 +++ Oi pms 0 [Smk] J1 
: Be ad! 38 ig : 
: oie A a : 
x,(k + 1) 00 0--- 61 0 Pal \Xn(k) 1 
x(k) 
x(k) 
y(k)= [c e +++ e] ^: | + boulk) (5-120) 
Xn(k) 
Solution Since the system pulse transfer function can be written in the form 
Y(z) I" boz" + biz"! Pd dE biz + b, 


U(z) (z -p)"(z — pn«)( — pu«2: € — Pn) 
(by — ai bo)z" ^? + (ba — azbo)z" ? + +++ + (b, — an bo) 


= boc a 
S (z — p)" (z — pus): 7 Pr) 
Cy C2 Cm 
= bo + —— + Se est tt 
Pee py (ace pitt z-p 
gem pL ONE p ate (5-121) 


Z — Pm+i Z — pm«2 Z —7 pa 
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we obtain 
" C1 EMEN ii Cm 
YG) = bU) + c s UG) + GU) + + + UG) 
+— Set (zy + zy +. + LL (a) 6-122 
Z — pma Z — Pm+2 Z 7 Pn 772 


Let us define the first m state variables Xi(z), X2(z),..., Xm(z) by the equations 


1 
Xi(z) = ——-—, U 
i(z) (z ~ pi" (z) 
1 
Xz) = ———MAU 
Az) (z-p)"' e) (5-123) 
X«(2) = ——— UQ) 
m peus Pi 
and the remaining n — m state variables X,,.i(z), Xm+2(2), ..., X, (z) by the equations 
1 
Xmei(Z) = eae U(z) 
Xmme2) = ———— Ue) 
mre Z — Pm+2 (5-124) 


X.(z) = U(z) 


Z — pn 


Notice that the m state variables defined by Equation (5-123) are related each to the 
next by the following equations: 


X,(z) e 1 

X2(z) “z= Pi 

Xx(z) ES 1 

X(2) z-p (5-125) 
X5s-i(z) nj 1 
Xm(z) “z= Pr 


By taking the inverse z transforms of all of Equation (5-125), the last equation in 
Equation (5-123), and all of Equation (5-124), we obtain 


x(k + 1) = pi x(k) + x(k) 
x(k + 1) = pi x(k) + x(k) 


Xm-K + 1) = piXm—-(k) + Xm(k) (5-126) 
Xm(k + 1) = pixXm(k) + u(k) 
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Xmi(k * 1) = Pm+iXtm+i(k) RH u(k) 


Xn(k + 1) = paxn(k)  u(k) 
The output equation given by Equation (5-122) can be rewritten as follows: 
Y(z) = «Xi2) + €2X2(z) + +++ + Cn Xm(Z) + Cm+1Xm+1(2) 
+ Cm+2Xm+2Z) + ++ c Xn(z) + bo U(z) 
By taking the inverse z transform of this last equation, we get 
y(k) = cr xi(k) + ex(k) + ++ + CmXm(K) + C41 Xmei(k) 
+ Cm+2Xm+2(K) + +++ + CnXa(k) + bou(k) (5-127) 


Rewriting Equations (5-126) and (5-127) in the standard vector matrix form, we obtain 
Equations (5-119) and (5-120), respectively. 
Problem A-5-5 
Using the nested programming method (refer to Problem A-5-2), obtain the state 
equation and output equation for the system defined by 
X) ce e pt 
U(z) 1+ 427! + 3z7? 


Then draw a block diagram for the system showing all state variables. 


Solution The given pulse transfer function can be written as 
Y(z) = z '(U(z) - 4Y(z) + z "[SU(z) — 3Y(z)]) 

Define 

Xi(z) = z '[U(z) — 4Y(z) + X2(z)] 

X,(z) = z '[5U(z) — 3Y(z)] 

Y(z) = Xi(z) 
Then we obtain 

zXi(z) = -4Xi(z) + Xx(z) + U(z) 

zX2,(z) = -3Xi(z) + 5U(z) 
The state equation can therefore be given by 

[36:3] os] ee 
and the output equation becomes 
son 209] 

Figure 5-3 shows the block diagram for the system defined by the state-space equations. 
The output of each delay element constitutes a state variable. 


Problem A-5-6 


Obtain a state-space representation of the system shown in Figure 5-4. The sampling 
period T is 1 sec. 
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u(k) 


Figure 5-4 Block diagram of the control system of Problem A-5-6. 


Solution We shall first obtain the z transform of the feedforward transfer function: 


_ofl-e* 1 EU 1 
d -z| s s(s zl ene x: * zl 
., 0.3679(z + 0.7181) 
(z — 1)(z — 0.3679) 
Then the closed-loop pulse transfer function can be obtained easily. There are many 
ways to obtain the state-space representation for such a system, as discussed in Sec- 
tion 5-2. In this problem, we shall demonstrate another approach, based on block 
diagram modification. 
Let us expand G(z) into partial fractions: 


1 0.6321 E z 0.6321z ! 
z—-1 2z-0.3679 1-z" 1-036795 


Figure 5-5 shows the block diagram for the system. Let us choose the output of each 
unit delay element as a state variable, as shown in Figure 5-5. Then we obtain 
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Figure 5-5 Modified block diagram for the system shown in Figure 5-4. 


zXi(z) = Xi(z) — [Xi(z) — 0.6321X(z)] + U(z) 
zX,(z) = 0.3679X2(z) — [Xi(z) — 0.6321X2(z)] + U(z) 
Y(z) = Xi(z) — 0.6321X,(z) 


from which we get 


x(k + 1) = 0.6321x2(k) + u(k) 
x(k + 1) = —x(K) + x(k) + u(k) 
y(k) = xi(k) — 0.6321x2(k) 


or 
x(k +1} | 0 0.6321 || x(k) 1 
E + 2 E 1 xu | * L1 jl 
x(k) 
= [1 -0.6321 
y(k) =[1 -0.63 Is] 
Problem A-5-7 
Obtain a state-space representation of the following pulse-transfer-function system: 


Y(z) - 5 
U(z) (z-1Y(z + 2) 
Use the partial-fraction-expansion programming method. Also, obtain the initial values 


of the state variables in terms of y(0), y(1), and y(2). Then draw a block diagram for 
the system. 


Solution Because we need the initial values of the state variables in terms of y (0), y (1), 
and y (2), we slightly modify the partial-fraction-expansion programming method pre- 
sented in Section 5-2. Let us expand Y(z)/U(z), zY(zyU(z), and z? ¥(z)/U(z) into 
partial fractions as follows: 
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Y) 5 _ 5 5 
U(z (z+1P zt+1 z+2 
2¥(z)____5  , 10 10 
U(z) (z-1y zt+1 2+2 
zY¥(z)___ 5 15 20 


U(z) (z+1ř z+1 z42 
Then we have 


Y(z) 1 
U(z) 5 5 5 (z +17 
zY(z) | | _ _ 1 
Ulz) | 5 10 —10 z+1 
z^ Y(z) B 1 
U(z) 5 15 2 z+2 
Now let us define the state variables by the following equation: 
Xi(z) 1 
U(z) (z * 1y 
X,(z) _ 1 
Uz) |~| z41 (5-128) 
X3(z) 1 
U(z) z+2 
Then the state variables X;(2), X2(z), and X;(z) are related to Y(z), zY(z), and z? Y(z) 
as follows: 
Y(z) 5 -5 5 || Xi(z) 
zY(z) |=] -5 10 -10| X2(z) (5-129) 
z^ Y(z) 5 -15 20] Xx(z) 


From Equation (5-128), we obtain 
(z + 1? Xi(z) = U(z) 
(z + 1)XxX(z) = U(z) 
(z + 2)Xs(z) = U(z) 
Noting that 
(z + 1)X,(z) = X,(z) 
we get 
zXi(z) = —Xi(z) + X2(z) 
zXz) = —X2(z} + U(z) 
z2X3(z) = —2X3(z) + U(z) 
The output Y(z) is given by the equation 
Y(z) = 5Xi(z) - 5X2(z) + 5X3(z) 
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Consequently, we have the state-space equations as follows: 
xi(k + 1) = —x,(k) + x(k) 
X2(k + 1) = —xX(k) + u(k) 
x(k + 1) = ~2x3(k) + u(k) 
y(k) = Sxi(k) — Sxa(k) + 5x3(k) 


or 
x(k + 1) -1 1 0 x(k) 0 
x(k + 1) = 0 -1 0 x(k) *|1 u(k) 
x(k + 1) 0 0 -2]| x(k) 1 
x(k) 
y(k)- [5 -5 S] xk) 
x(k) 
The initial data are obtained by use of Equation (5-129), as follows: 
xi(0) 5 -5 5] Ty) 
x(0)|2|]—5 10 -10 y(1) 
x3(0) 5 -15 20 yQ) 
$ i Of y(0) 
-]$ 3 i|» 
$$ DO 
The block diagram for this system is shown in Figure 5-6. 


Problem A-5-8 


Obtain a state-space representation of the following pulse-transfer-function system such 
that the state matrix is diagonal: 

Y(z) E z? + 8z? + 17z + 8 

U(z) (z+ Itz + 2)(z + 3) 
Then obtain the initial state x(0) in terms of y(0), y(1), y(2) and u(0), u(1), u(2). 


Solution Let us first divide the numerators of the right-hand sides of Y(zyU(z), 


zY(z)/U(z), and z^ Y(z)/U(z) by the respective denominators and expand the remain- 
ing terms into partial fractions, as follows: 


Figure 5-6 Block diagram for the system considered in Problem A-5-7. 


348 


State-Space Analysis 
Y(z) | i- 1 " 2 1 
U(z) z+1 z+2 z+3 
zY(z) _ 1 4 3 
U(z) t2 T1 z-2 z+3 
zY() , 1 8 9 
U(z) = 2 + 22 6-241'242^z243 
Rewriting, we have 
Y(z) -U() — 1 + 2 1 
U(z) z+1 z+2 z+3 
zY(z -zU(2) -2U(z2 | 1 4 _ 3 
U(z) ^zt*l z*2 z+3 
ziY(z — z? U(z) — 2zU(z) + 6U(z) X 1 8} 9 
U(z) ^ z+1 z*2 z-3 
or 
Y(z) - U(z) _ 1 
UG) 1 2 Naa 
zY(z) — zU(z) - 2U(z) -| 1-4 -3 1 
U(z) z+2 
z^ Y(z) — z? U(z) — 2zU(z) + 6U(z) i 8 9 1 
U(z) z+3 
Let us define the state variables X,(z), X2(z), and X3(z) as follows: 
xe) [a 
U(z) z+1 
X,(z) = 1 
u(z) z+2 
Xs(z) 1 


U(z) z t3 
Then we have 


Y(z) - U(z) -1 2 1| Miz) 
zY(z) — zU(z) - 2U(z) 1 -4 -3]| X2(z) 
z^ Y(z) — z^ U(z) - 2zU(z) + 6U(z) -1 8 9] X;3(z) 


Notice that Equation (5-130) can be written as 
zXi(z) = —X\(z) + U(z) 
zX,(z) = —2X,(z) + U(z) 
zXs(z) = —3X3(z) + U(z) 
from which we obtain 
x(k + 1) = —xi(k) + u(k) 
x(k + 1) = —2x2(k) + u(k) 
x3(k + 1) = —3x3(k) + u(k) 


Chap. 5 


(5-130) 


(5-131) 


PR 
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The output Y(z) is given by 

Y(z) = —Xi(z) + 2X2(z) + X3(z) + U(z) 
or 

y(k) = —xi(k) + 2xo(k) + x3(k) + u(k) 


In vector-matrix notation, the state space equations become 


x(k + 1) -1 0 OF x(k) 1 
x(k*1|-| 0 -2 Off x(k)} +] 1 u(k) 
x(k + 1) 0 0 -3 x(k) 1 
x(k) 
y(k)=[-1 2 1]xx(&)|- u(k) 
x(k) 

The initial data are obtained from Equation (5-131) as follows: 
xı(0) ZUM NE WS y(0) — u(0) 
x(0)|-| 1 -4 -3 y(1) - u(1) - 2u(0) 
x3(0) -1 8 9 y(2) - uQ) - 2u(1) + 6u(0) 

deg og »(0) — u(0) 
=|=} -2 -i|| 0 -«)-24() 
|: 31]»Q)-«Q)-2u() + 6u(0) 


Figure 5-7 shows the block diagram for the present system. 


Figure 5-7 Block diagram for the system considered in Problem A-5-8. 
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Problem A-5-9 
Let A be an n X n matrix, and let its characteristic equation be 
JAI- A| = à” +a A +++) +a,1A +a, = 0 
Show that matrix A satisfies its characteristic equation, or that 
A" + @A7™14+-->+a,1At+a,1=0 
(This is the Cayley-Hamilton theorem.) 


Solution We first note that adj (AI — A) is a polynomial in A of degree n — 1. 
That is, 


adj (AI - A) = BA"! + B;A*? + «t B4À + B, 
where 
B, =I 
Note also that 
(AI — A) adj (AI — A) = [adj (AI — A)JOI — A) = [Al — AIT 
Hence, we obtain 
AT — AJI = IA” + a A" + + ana + aul 
= (AI — AB;A! + BA ^ + -+ + Bn- AÀ + B,) 
= (B,A"' + BoA”? + 5: + Bay A + B;)(AI — A) 


From this equation we see that A and B; (i = 1,2, . . . ,n) commute. Hence, the product 
of (AI — A) and adj (AI — A) becomes zero if either of these is zero. If A is substituted 
for A in this last equation, then clearly AI — A becomes zero. Hence, 


A" + aA"! +e +a,1A+4,1=90 


This proves the Cayley-Hamilton theorem. 


Problem A-5-10 


Referring to Problem A-5-9, it has been shown that every n x n matrix A satisfies its 
own characteristic equation. The characteristic equation is not, however, necessarily the 
scalar equation of least degree that A satisfies. The least-degree polynomial having A 
as a root is called the minimal polynomial. That is, the minimal polynomial of ann x n 
matrix A is defined as the polynomial (A) of least degree: 


P(A) = A" + a,A b sb amà tam, mn 
such that @(A) = 0, or 
P(A) = A" + a. A" + -+ + am-iÅ + ant = 0 


The minimal polynomial plays an important role in the computation of polynomials in 
ann X n matrix. 

Let us suppose that d(A), a polynomial in A, is the greatest common divisor of 
all the elements of adj (AI — A). Show that if the coefficient of the highest-degree term 
in A of d(A) is chosen as 1 then the minimal polynomial ¢(A) is given by 

JAI — Al 
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Solution By assumption, the greatest common divisor of the matrix adj (AI — A) is 
d(A). Therefore, 


adj (AI — A) = d(A)B(A) 


where the greatest common divisor of the n? elements (which are functions of A) of B(A) 
is unity. Since 


(AI — A) adj (AI — A) = [AI — AJI 


we obtain 
d(A)(AI — A)B(A) = JAI — AJI (5-132) 
from which we find that |AI — A| is divisible by d(A). Let us put 
[AI — Al = 4(A(A) (5-133) 


Then the coefficient of the highest-degree term in A of (A) is unity. From Equations 
(5-132) and (5-133), we have 


(AI — A)B(A) = 9(A)I 
Hence, 
WA) = 0 
Note that (A) can be written as follows: 
YCA) = g(A)P(A) + a(A) 


where a(A) is of lower degree than $(A). Since #(A) = 0 and (A) = 0, we must have 
a(A) = 0. Since (A) is the minimal polynomial, a(A) must be identically zero, or 


WA) = (A) P(A) 

Note that because #(A) = 0 we can write 
$(A)I = (AI - A)C(A) 
Hence, 
WAIT = (4)60)IE = gQ)I — A)C(A) 

and we obtain 

BOA) = g(A)C(A) 
Note that the greatest common divisor of the n? elements of B(A) is unity. Hence, 


g0) 71 
Therefore, 
WA) = $A) 
Then, from this last equation and Equation (5-133), we obtain 
_|AL- Al 
f(A) = d(A) 


It is noted that the minimal polynomial @(A) of an n x n matrix A can be 
determined by the following procedure: 


1. Form adj (AI — A) and write the elements of adj (AI — A) as factored polynomi- 
als in A. 
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2. Determine d(A) as the greatest common divisor of all the elements of 
adj (AI — A). Choose the coefficient of the highest-degree term in A of d(A) to 
be 1. If there is no common divisor, d(A) = 1. 


3. The minimal polynomial (A) is then given as |AI — A| divided by d(A). 


Problem A—5-11 


If an n X n matrix A has n distinct eigenvalues, then the minimal polynomial of A is 
identical with the characteristic polynomial. Also, if the multiple eigenvalues of A are 
linked in a Jordan chain, the minimal polynomial and the characteristic polynomial are 
identical. If, however, the multiple eigenvalues of A are not linked in a Jordan chain, 
the minimal polynomial is of lower degree than the characteristic polynomial. 

Using the following matrices A and B as examples, verify the foregoing statements 
about the minimal polynomial when multiple eigenvalues are involved. 


214 20 0 
A=]0 2 0j, B-|02 0 
03 1 03 1 
Solution First, consider the matrix A. The characteristic polynomial is given by 
A-2 -1 -4 
jiar—Aj=| 0 a-2 0 |-Q0-2yQ0-1) 
0 -3 A-1 
Thus, the eigenvalues of A are 2, 2, and 1. It can be shown that the Jordan canonical 
form of A is 
210 
02 0 
0 0 1 


and the multiple eigenvalues are linked in the Jordan chain as shown. (For the procedure 
for deriving the Jordan canonical form of A, refer to Appendix A.) 
To determine the minimal polynomial, let us first obtain adj (AI — A). It is 


given by 
(A - 2)(A - 1) (A + 11) 4(A — 2) 
adj (AI — A) = 0 (A — 2)(A - 1) 0 
0 3(A — 2) (A —- 2? 


Notice that there is no common divisor of all the elements of adj (AI — A). Hence, 
d(A) = 1. Thus, the minimal polynomial $(A) is identical with the characteristic poly- 
nomial, or 


(A) = | - Al = A - 2/0 - 1) 
2A —52 08-4 
A simple calculation proves that 
A? —5A* + BA — 41 =0 
but 
A? -3A + 2I 4 0 


Thus, we have shown that the minimal polynomial and the characteristic polynomial 
of this matrix A are the same. 
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Next, consider the matrix B. The characteristic polynomial is given by 


A-2 0 0 
AI-Bl=| 0 a-2 0 |-(-2Y0-1 
0 -3 A-1 


A simple computation reveals that matrix B has three eigenvectors, and the Jordan 
canonical form of B is given by 


on 
N 0c 


Thus, the multiple eigenvalues are not linked. To obtain the minimal polynomial, we 
first compute adj (AI — B): 


(A - 2) —- 1) 0 0 
adj (AI — B) = 0 (A — 2)(A — 1) 0 
0 3(A — 2) (A - 2 
from which it is evident that 
d(A)=A-2 
Hence, 
_ -B| 0-2y0-1  , 
(à) = d(A) V À-2 —A —3A +2 
As a check, let us compute $(B): 
400 2 0 0 100 000 
$(B -B'-3B*21-]04 0/-3/0 2 0|42]0 1 0]210 0 0 
09 1 03 1 00 1 000 


For the given matrix B, the degree of the minimal polynomial is lower by 1 than that 
of the characteristic polynomial. As shown here, if the multiple eigenvalues of ann X n 
matrix are not linked in a Jordan chain, the minimal polynomial is of lower degree than 
the characteristic polynomial. 

Problem A-5-12 
Show that by use of the minimal polynomial the inverse of a nonsingular matrix A can 
be expressed as a polynomial in A with scalar coefficients as follows: 


A` = -L (am + ay AUT ro Amr A + asl) (5-134) 


where 41,22, ... ,Am are coefficients of the minimal polynomial 
P(A) = A" c aA! o + Gn A + Om 


Then, obtain the inverse of the following matrix A: 


1 2 0 
A=|3 -1 -2 
1 0 -3 


Solution For a nonsingular matrix A, its minimal polynomial (A) can be written as 
follows: 
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$(A) = A" + a A" bee + Gn1A asl 0 
where am + 0. Hence, 
I= - =a" + a AU + 05) duo A? + aua A) 
Premultiplying by A~', we obtain 
A= - an + ay A”? + eee + agg A + amil) 


which is Equation (5-134). 
For the given matrix A, adj (AI — A) can be given as follows: 


+4043 2A +6 —4 
adj (AI - A)=| 3A+7  AX-*2A4-3 -2+2 
Ac*1 2 A^-7 


Clearly, there is no common divisor d(A) of all elements of adj (AI — A). Hence, 
d(A) = 1. Consequently, the minimal polynomial $(A) is given by the equation 
n GIBT a A| 
é( ) 7 d( À) ~ 
Thus, the minimal polynomial $(A) is the same as the characteristic polynomial. 
Since the characteristic equation is 


JAI — A| = A° + 3A7~ 7A —- 17 = 0 


we obtain 
(A) = à? + 37 - 7A — 17 


By identifying the coefficients a; of the minimal polynomial (which is the same as the 
characteristic polynomial in this case), we have 


a= 3, a= -7, a, >= -17 
The inverse of A can then be obtained from Equation (5-134) as follows: 


1 
At = -> (A? + aA + aI) = zo + 3A - 7D 


iff 7 0 -4 1 2 0] [100 
-24 727 8|*33 -1 -2]-70 1 0 
22 9 1 0 -3| |0 0 1 
[3 6 -4 
oa -3 2 
Iji 2 -7 
2 Go 024 
17 17 17 
=/2 —-3 A 
17 17 17 
4 ZA —L 
17 17 17 


Problem A-5-13 
Show that the inverse of zI — G can be given by the equation 
adj (zI — G) 
lz1 — G| 
1z"! + Hiz”? + Boz" +-+ + Hpi 


gere EE (5-135) 


G1-G)!- 
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where 
Hi-G-ail 
H- = GH, + aI 
H,,-1 = GH,-2 + anil 
H, = GH, rı + 4,1 =9 
og 41, 02, . . . , ân are the coefficients appearing in the characteristic polynomial given 
y 


l'I-G|9z"*taz"'-*az"?^---ta, 


Show also that 


a, = —trG 

a, = —itrGH, 
1 

a, = —— trGH,-; 
n 


To simplify the derivation, assume that n = 3. (The derivation can be easily extended 
to the case of any positive integer n.) 


Solution Note that 
(zI — G)(Iz? + Hız  H) = 21 - zG + zHi — zGH, + zH, - GH, 
= 21-26 + 2(G + aI) - zG(G + al) 
+ z[G(G + a I) + aI] - G[G(G + a I) + a;I] 
-glItazlc-az;tal-G 
—aiG — aG — aI (5-136) 


The Cayley-Hamilton theorem (see Problem A—5-9) states that an n X n matrix G 
satisfies its own characteristic equation. Since n — 3 in the present case, the character- 
istic equation is 
zI - G| = 2° + az? + az +a =0 
and G satisfies the following equation: 
G taG + aG + al=0 
Hence Equation (5-136) simplifies to 
(zI — G)(Iz* + Hız + Hz) = (z? + aiz? + az + a)i = |z1 - GJI 


Consequently, 
tS (zI - G)(Iz* + Hız + H2) 
lz1 — G| 
or 
eI- Gy = Iz + Hiz + H; 


lz1 — G| 
which is Equation (5-135) when n = 3. 
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Next, we shall show that 


a= —trG 
a= —-itrGH, 
a= -4 tr GH: 


We shall transform G into a diagonal matrix if G involves n linearly independent 
eigenvectors (where n = 3 in the present case) or into a matrix in a Jordan canonical 
form if G involves fewer than n linearly independent eigenvectors. That is, 


P^'GP = D = matrix in diagonal form 
Or 
S! GS = J = matrix in a Jordan canonical form 


where matrices P and S are nonsingular transformation matrices. 

Since the following derivation applies regardless of whether matrix G can be 
transformed into a diagonal matrix or into a matrix in a Jordan canonical form, we shall 
use the notation 


T` GT = Ô 


where D represents either a diagonal matrix or a matrix in a Jordan canonical form, as 
the case may be. 
In the following we shall first show that 


trG =tD 
tr GH, = tr Ô, 
tr GH; = tr DÉL, 
where 
H, = Ô + aI 
fi, = DH, + aI 
Then we shall show that 


a, = -trD 

a= —Àitr DH, 

a, = -itr D 
Notice that since 

tr AB = tr BA 


we have 
tr TÔT”! = tr(TD)(T) = tr(T- (TD) = tr Ô 
Notice also that 
tr(A + B) 7 trA + trB 
Now we have 
trG = tr TÔT” = trD 
tr GH, = trG(G + a, I) = trG’ + traiG 
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= tr TÔ? T^ + tra, TÔT 
= trD? + tra D = tr (Ô? + a, D) = tr DA, 
tr GH: = trG(GH, + a;I) = tr G[G(G + a, I) + aI] 
= tr (G? + a @ + aG) 
= tr TD^ T^! + tra, TD?T + tra; TÔT! 
= trD? + tra, D? + tra D 
= tr(D? + a Ô? + a; D) = tr ÔÊ, 
Let us write 


. |a * 0 
T'GT-D-|0 p * 
0 0 P3 


where an asterisk denotes “either 0 or 1." Then 


Iz — | = z? - (px + po + ps)z? + (pipi + paps + psp)z — pipops 
=z + az? + az +a 
where 


a, = —(pi + p2 + ps) 
a2 = Pip2 + props + p3pı 
43 = —Pi P2P3 
Notice that 
trD = pi + po + ps = ~a 
tr DA, = tr DW + a1) = BP + tra, D 
= pi + p2 + ps — (pr + po + ps)(pi + po + ps) 
= —2(pip2 + pipa + papi) = —2a2 
tr DH, = trD(DA, + aI) = tr (D? + a D? + aD) 
= trD? + tra D? + tra; D 
= (pi + pa + p3) — (pr + Pa + pipi + pi + p3) 
+ (pipa + papas + pspr)(pi + pa + ps) 
= 3pipaps = —3as 
Thus, we have shown that 
a, = -trD = -trG 
a, = -4 trDH, = — 3 tr GH, 
~ 4 tr GH: 


a 
w 
| 
| 
we 
or 
Ha 
iz 
X 
N 
H 


Problem A-5-14 


Consider the following oscillator system: 
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Obtain the continuous-time state-space representation of the system. Then discretize 
the system and obtain the discrete-time state-space representation. Also obtain the 
pulse transfer function of the discretized system. 


Solution From the given transfer function, we have 


j^wy-wu 


Define 
Xx17—7y 
X27 ay 
2 má 


Then we obtain the following continuous-time state-space representation of the system: 
i]- L5 cle} [eh 
Xo —w Of] x w 
ES x 
ysn ez 


The discrete-time state-space representation of the system is obtained as follows. 
Noting that 


we have 
-1 
= pAT = ¢p-l -ayy ggj se 
G-e £"[(sI - A) `°] = € ll 2| | 
s w 
2 2 2 + 2 i 
2g SIYE BER L| coswT sinoT 
i -w s —sinwT coswT 
Sco Sco 
and 


H- [eran B= K coswà sinwA |, |. 0 
o o | —SinwA cos wà w 
— |1- cosoT 
sin wT 
Hence, the discrete-time state-space representation of the oscillator system becomes 
as follows: 


p + 2| A | coswT sin EH " | — cos oT 


xo((k +1)T)} |-sineT coseT || x2(kT) sin oT han 


y(kD) = [1 of 20 | 


The pulse transfer function of the discretized system can be obtained from 
Equation (5—60): 


F(z) = C(zI - ^H + D 
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Noting that D is zero, we have 


[ o] z —cosoT  -sineT | |1- cosoT 
sin wT z — cosoT sin oT 


1 [1 oj — coswT sin oT In = d 


F(z) 


z?-2zcoseT + 1 —sineT z—coswT sin wT 
_ (1 = coswT)(z + 1) 
z? ~ 2z coswI + 1 
Hence, 
Y(z) _ Gz (1 — coswT)(1 + z z^ 
U(z) 1 — 2z7' coswT tz ? 


Note that the pulse transfer function obtained in this way is the same as that obtained 
by taking the z transform of the system that is preceded by a zero-order hold. That is, 


YZ) cos Mier ae Le polls uk 
r e| 0-3 quu GS ale + ow? 
1 1 — z™ coswT 
= -— 77! - ——————— 
bos l: —-z! 1-2z™coswT + =) 
(1 — coswT)(1 + z z^! 
1 ~ 2z! coswT + z^ 


Thus, we get the same expression for the pulse transfer function. The reason for this 
is that discretization in the state space yields the zero-order hold equivalent of the 
continuous-time system. 


Problem A—5-15 


Consider the system shown in Figure 5-8(a). This system involves complex poles. It is 
stable but not asymptotically stable in the sense of Liapunov. Figure 5-8(b) shows a 


U(s) 2 Y(s) 


EE eel 
ôr yiz) 


ib) 


Figure5-8 (a) Continuous-time system of Problem A—5-15; (b) discretized version 
of the system. 
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discretized version of the continuous-time system. The discretized system is also stable 
but not asymptotically stable. 

Assuming a unit-step input, show that the discretized system may exhibit hidden 
oscillations when the sampling period T assumes a certain value. 


Solution The unit-step response of the continuous-time system shown in Figure 5—8(a) 
is 


s$ 1 s 


S+t4s s*+4 


Y(s) = 


Hence, 
y(t) = cos2t 
[Notice that the average value of the output y(t) is zero, not unity.] The response y(t) 
versus ¢ is shown in Figure 5—9(a). 
y(t) 


1 


(a) 


(b) 


(c) 


Figure 5-9 (a) Unit-step response y(t) of the continuous-time system shown in 
Figure 5-8(a); (b) plot of y(kT) versus kT of the discretized system shown in Figure 
5-8(b) when T = } asec; (c) plot of y(kT) versus kT of the discretized system when 
T = asec. (Hidden oscillations are shown in the diagram.) 


i 


i 
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The pulse transfer function of the discretized system shown in Figure 5-8(b) is 


Jio tcp Ic m NY eum tena s 
z-e] s sue g [5l 


Fw 1 — z` cos2T 
Cre ^ —2z  cos2T + z ? 


Hence, the unit-step response is obtained as follows: 
(1—z7)(1-2^cos2T) 1 
1-2z'cos2T +27 1-z^ 
= 1 — z~’ cos2T 
1 — 2z7' cos2T tz 


Y(z) = 


The response y (kT) becomes oscillatory if T + nasec(n = 1,2,3,... ). For example, 
the response of the discretized system when T = iq sec becomes as follows: 


Y(z) = =J]—277?+27 4-774... 


1+27? 
Hence, 
y(0)=1 
y(T) = 0 
y(2T) = -1 
y(3T) 20 


y(4T) = 1 


A plot of y(kT) versus kT when T = } 7 sec is shown in Figure 5—9(b). Clearly, the 
response is oscillatory. If, however, the sampling period T is v sec, or T = m, then 


aden Jee et). Suo. cH 
EGS 1-2; !4z? 1-zg! 1-z1 


=L+z2t+z74+734.-. 


The response y(kT) for k = 0,1,2,... is constant at unity. A plot of y(kT) versus kT 
when T = ~ is shown in Figure 5-9(c). 

Notice that if T = m sec (in fact, if T = nz sec, where n = 1,2,3,...) the 
unit-step response sequence stays at unity. Such a response may give us an impression 
that y(¢) is constant. The actual response is not unity but oscillates between 1 and —1. 
Thus, the output of the discretized system when T = asec (or when T = na sec, where 
n = 1,2,3,...) exhibits hidden oscillations. 

Note that such hidden oscillations (hidden instability) occur only at certain 
particular values of the sampling period T. If the value of T is varied, such hidden 
oscillations (hidden instability) show up in the output as explicit oscillations. 


Problem A-5-16 


Even though the double-integrator system is dynamically simple, it represents an 
important class of systems. An example of double-integrator systems is a satellite 
attitude control system, which can be described by 


JO=uty 
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where J is the moment of inertia, @ is the attitude angle, u is the control torque, and 
v is the disturbance torque. 

Consider the double-integrator system in the absence of disturbance input. 
Define J@ = y. Then the system equation becomes 


yeu 
Obtain a continuous-time state-space representation of the system. Then obtain a 


discrete-time equivalent. Also obtain the pulse transfer function for the discrete-time 
system. 


Solution Define 
X17—7y 
X2 = y 


Then the continuous-time state equation and output equation become 
Xi = 0 1 X1 0 
EHE. 
= xi 
y= of a 


The discrete-time equivalent of this system can be given by 
x((k + 1)T) = Gx(kT) + Hu(kT) 
y(kT) = Cx(kT) 
Matrices G and H are obtained from Equations (5-73) and (5-74). Noting that 


e ef 


we have 


and " 


«(Con J-l 


Hence, the discrete-time state equation and output equation become 


T? 
xi(k +1)T)| |1 T|x(kT) E 
[E +1)F)|~ [0 ilean] |; «D 
= xi(kT) 
The pulse transfer function of the discrete-time system is obtained from Equation 
(5-60) as follows: 
Y(z) 


U@) = F(z) = C(zI - G)'H+D 
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H 


[1 al 0 l Al 2149 
Tet) Tz'ü-z? 
»O2z-1y  2ü-zy 


Problem A-5-17 
Show that the following quadratic form is positive definite: 
V(x) = 10x? + 4x3 + x3  2onxa — 2xaxs — Axixs 
Solution The quadratic form V(x) can be written as follows: 


10 1 -2|lx 
V(x) =x Px= [xr x; x] 1 4 -11) x 


-2 -1 1| xs 
Applying Sylvester's criterion, we obtain 
10 > 0, 4 "ED 1 4 E >0 
-2 -1 1 
Since all the successive principal minors of the matrix P are positive, V(x) is positive 
definite. 
Problem A-5-18 
Consider the system defined by 
X = f(x,t) 


Suppose that 
f(0,7) ^ 0,  forallt 


Suppose also that there exists a scalar function V(x, t) that has continuous first partial 
derivatives. If V(x, t) satisfies the conditions 


1. V(x, t) is positive definite. That is, V(0,7) = 0 and V(x, t) = a(lix|) > 0 for all 
x # 0 and all t, where a is a continuous nondecreasing scalar function such that 
a(0) = 0. 

2. The total derivative V(x,r) is negative for all x 4 0 and all ¢, or V(x, t) = 
— y(lix|) < 0 for all x * 0 and all t, where yis a continuous nondecreasing scalar 
function such that y(0) = 0. 

3. There exists a continuous nondecreasing scalar function 8 such that 8(0) = 0 and, 
for all t, V(x, t) = B((|x\l). 

4. o(|x|) approaches infinity as |[x|| increases indefinitely, or 


a(lx|)— ^», as |x|% 
then the origin of the system, x = 0, is uniformly asymptotically stable in the large. (This 


is Liapunov's main stability theorem.) 
Prove this theorem. 
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Solution To prove uniform asymptotic stability in the large, we need to prove the 
following: 


1. The origin is uniformly stable. 
2. Every solution is uniformly bounded. 


3. Every solution converges to the origin when t— © uniformly in to and |xo|| = ô, 
where 6 is fixed but arbitrarily large. That is, given two real numbers 6 > 0 and 
p > 0, there is a real number T(z, 8) such that 


I|xoll = 6 
implies 
llb (£; Xo, to) || = m, for all £ = to + T(u, 6) 
where (; xo, fo) is the solution to the given differential equation. 


Since f is continuous and B(0) = 0, we can take a ó(e) > 0 such that 8(8) < a(e) for 
any e > 0. Figure 5-10 shows the curves a(|x|), (xl), and V(x, 2). Noting that 


V(o(t; Xo, to), t) a V(Xo, to) = Í V(é(7; Xo, to), 7) dr< 0, t > to 
to 


if ||xol| = 8, to being arbitrary, we have 
a(e) > B(8) = V(xo,fo) = V(e(t; xo, fo), f) = a(ll(t; xo, to)l) 
for all 1 = ty. Since a is nondecreasing and positive, this implies that 
lebt; xo, to)] < €, for t = to, ||xo]| = 6 


Hence, we have shown that for each real number e > 0 there is a real number 8 > 0 
such that ||xoll = Simplies ||(¢; xo, to)|| = efor all t = to. Thus, we have proved uniform 
stability. 

Next, we shall prove that |l@(¢;Xo, fo) ^ 0 when t— uniformly in t; and 
[xo|| 8. Let us take any 0 < u < ||xoll and find a x(u) > 0 such that B(v) < o(4). Let 


BUI x 10 


ale) 


8brp----- 


e (I) x II) 


0 te) € IX Il 
Figure 5-10 Curves o(|x|), 8(Ixl), and V(x, £). 
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us denote by e'(u, ô) > 0 the minimum of the continuous nondecreasing function 
Y(llxl) on the compact set x(u) = |ix|| = e(8). Let us define 


B(8) 
€'(u, ô) 
Suppose that ||b(t; xo, to)]| > v over the time interval to € t = t, = to + T. Then we have 

0 < a(v) = V(b(t; xo, to), t) = V(Xo, to) — (h — te’ < B(8) - Te' = 0 


which is a contradiction. Hence, for some tin the interval tj x t < tı, such as an arbitrary 
h, we have 


T(u,8) = >0 


Ix2ll  llb(t; xo, fo)ll = v 
Therefore, 
a(|b(t; x2, 2) < V(d(t x2, 2), t) = V(x2, t) = B(v) < a(p) 
for all £ = t;. Hence, 
l(t; xo, t))] < u 


for all ¢ = to + T(u,8) =t, which proves uniform asymptotic stability. Since 
a(||x||)—> © as |x|| æ, there exists for arbitrarily large ô a constant e(ô) such that 
B(8) < a(€). Moreover, since e(8) does not depend on t, the solution $(t; Xo, fo) is 
uniformly bounded. We thus have proved uniform asymptotic stability in the large. 


Problem A-5-19 


In z plane analysis, an n X n matrix G whose n eigenvalues are less than unity in 
magnitude is called a stable matrix. Consider an n x n Hermitian (or real symmetric) 
matrix P that satisfies the following matrix equation: 


G*PG - P = -Q (5-137) 


where Q is a positive definite n x n Hermitian (or real symmetric) matrix. Prove that 
if matrix G is a stable matrix then a matrix P that satisfies Equation (5-137) is unique 
and is positive definite. Prove that matrix P can be given by 


P= 2 (G*) QG^ 


Prove also that although the right-hand side of this last equation is an infinite series the 
matrix is finite. Finally, prove that if Equation (5-137) is satisfied by positive definite 
matrices P and Q, then matrix G is a stable matrix. Assume that all eigenvalues of G 
are distinct and all eigenvectors of G are linearly independent. 


Solution Let us assume that there exist two matrices P, and P; that satisfy Equation 
(5-137). Then 


G*P,G- P; = -Q (5-138) 
and 
G*P.G — P, = -Q (5-139) 
By subtracting Equation (5-139) from Equation (5-138), we obtain 
G*PG -P-0 (5-140) 
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where 
Ê =P, -P 
Notice that if P + 0, then there exists an eigenvector x; of matrix G such that 
Px; + 0 
Let us define the eigenvalue that is associated with the eigenvector x; to be A. Then 
Gx; = À; X; 
Hence, from Equation us we obtain 
G*PGx, - = G*PA,x; — Px; = (à; G* - DPx; = 0 (5-141) 


Equation (5-141) implies that A; ^ is an eigenvalue of G*. Since |A,| < 1, we have 
|A; '| > 1. This contradicts the assumption that G is a stable matrix. Hence, P must be 
a zero matrix, or it is necessary that 


P,-P 


Thus, we have proved the uniqueness of the matrix P, the solution to Equation (5-137). 
To prove that a matrix P that satisfies Equation (5-137) can be given by 


P = Y (G9*Qc* (5-142) 


k=0 


we may rewrite Equation (5-142) as follows: 
P = (G*)°QG° + X (G9*QG^ = Q+ o 3 Conca 
k=1 k=0 


= Q + G*PG 


Thus, Equation (5-137) is satisfied. Since matrix Q is a positive definite matrix, from 
Equation (5-142) matrix P is also positive definite. 

We shall now prove that, although matrix P given by Equation (5-142) is the sum 
of an infinite series, itis a finite matrix. Because of the assumptions made in the problem 
statement, the eigenvalues A; are distinct and the eigenvectors of G are linearly inde- 
pendent. For the eigenvalue A; that is associated with the eigenvector x;, we have 


Gx; = Ài Xi 
By using this relationship, we may simplify x? b (G*)* oc. First note that 
k=0 


x} (G*) QG? x; = (x7 G*)(G*QG)(Gx.) = Asx? G*QGA: x; 
= [f(x G*Q(Gx) = JAPA xA: x) 
= [flf x* Qx; 
Then, by using this type of simplification, we have 
x? È (G*)* oc. = xf Qx; + x' G*QGx, + x (G* QG'x, + x* (G* QG' x, +- 
mm = xf Ox; + A;A;x* Qx:  AIPIAP x* Qx, + AA x? Qx: 


xo 
= x* Qx(1 + [AP + Du + JA + e) 
= x? Qx; : 


1 mE PAK 
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This proves that 


Ma 


(G*)' QG* 


k-0 


is a finite matrix. 

Finally, we shall prove that if Equation (5-137) is satisfied by positive definite 
matrices P and Q then matrix G is a stable matrix. Let us define the eigenvector 
associated with an eigenvalue A; of G as x;. Then 


Gx; = À;Xi 

By premultiplying both sides of Equation (5-137) by x* and postmultiplying both sides 
by x;, we obtain 

xl G*PGx, — x? Px; = —x} Qx: 
Hence, 

Àixf PA; x, — x? Px, = —x* Qx; 
or 

(JA — Dx? Px; = —x¥ Qx; 


Since both x? Px, and x? Qx; are positive-definite, we have 
Af- 1<0 
or 
lu <1 
Hence, we have proved that matrix G is a stable matrix. 
It is noted that the proofs and derivations presented here can be extended to the 
case where matrix G involves multiple eigenvalues and multiple eigenvectors. 
Problem A-5-20 


Consider the system 
x(k + 1) = H(x(k))x(k) 


Assume that there exist positive constants c,,c2,...,c, such that either 


n 


(1) max [$5 hue] «1,  forallx 


jas 
or 


(2) max [$5 hen] <1,  foralx 
J izl1Vj 
Show that in either case H(x)x is a contraction for all x and therefore the equilibrium 
state of the system is asymptotically stable in the large. 


Solution In case 1, define the norm by 
Ix] = max (cix, 
Then 


| H(x)x|| = max fe Y hya); | = max be lh: ;(x)| e] 
i j21 i jai Cj 
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= max [5s hofa max foil < TAR {ejlx;]} 


i jai’ 
= [xli 
which verifies that H(x)x is a contraction. 
In case 2, define the norm by 


n 


Ixi = 2 ci 
Then 
IHG)xl = È cx] 22 hux 
= x. > |h a)l chl 


Ba 


= |xli 


which shows that H(x)x is a contraction. 
Now consider a scalar function V(x) = ||x|. Clearly, V(x) = ||x|| is positive defi- 
nite and 


dd. 


$50). » cilx;| < 2 cjlx;| 


AV(x(k)) = V(x(k + 1)) - V(x(k)) 
= |H(x(k))x(k)l — lIx(&)]| < 0 
and 
AV(0) = 0 


Thus, AV(x) is negative definite. Hence, V(x) = ||x|| is a Liapunov function for the 
system considered, and by Theorem 5—5 the origin of the system is asymptotically stable 
in the large. 


Problem A-5-21 
Prove that if all solutions of 
x(k + 1) = Gx(k) (5-143) 


where x is an n vector and G is ann X n constant matrix, tend to zero as k approaches 
infinity, then all solutions of the system 


x(k + 1) = Gx(k) + Hu(k) (5-144) 


where His an n X r constant matrix, are bounded, provided that the input vector u(x), 
an r vector, is bounded. 


Solution Since u(&) is bounded, there exists a positive constant c such that 
| u(&)|| < c, k =0,1,2,... 
The solution of Equation (5-144) is given by 


x(k) = G*x(0) + Y cnm - 1) 
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Hence, 
k ] k f 
Ilx(&)Ii < IIGII*x(0)] + c 2 IGI HI) = [|G *1x(0)|] + lim c > GIH] 
j=1 =% jel 


Since the origin of the homogeneous system given by Equation (5-143) is asymptotically 
stable, there exist positive constants a and b (0 < b < 1) such that 
0 < IGI < ab* 


Then 


k k 
lim > IGI « lim È ab* = ài 1 
mone 


koe jad —b 


Therefore, 


IxQOI < ali(0)] + cla —— 
We have thus proved that ||x(k)|| is bounded. 
Problem A-5-22 
Consider the system defined by the equations 
xi(k + 1) = 2xi(K) + 0.5x2(k) — 5 
x(k + 1) = 0.8x2(k) + 2 
Determine the stability of the equilibrium state. 
Solution Define the equilibrium state as 
x(k) = Xie, x(k) = Xz 


Then such an equilibrium state can be determined from the following two simultaneous 


equations: 
Xie = 2Xie + 0.5x,, — 5 
X2, = 0.8x,, + 2 
or 
Xi =0, Xx = 10 


The equilibrium state is thus (0, 10). 
Now let us consider a new coordinate system with the origin at the equilibrium 
state. Define 


i(k) = x(k) 
X2(k) = x(k) — 10 
Then the system equations become 
£i(kK + 1) = 241(k) + 0.5[£(k) + 10] — 5 
K(k + 1) + 10 = 0.8[4,(k) + 10] + 2 


Bs + n] E E HBA 
f(k-1) |0 0.8] (k) 


or 
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To determine the stability of the origin of the system in the new coordinate system, let 
us apply the Liapunov stability equation given by Equation (5-90): 


2 0 pu pi 2 0.5 = pu pio "E 9 0 
0.5 0.8 pa Pz 0 0.8 Pi2 Pz 0 0.35 


where we choose Q to be a positive definite matrix having elements that simplify the 
computation involved. Solving this last equation for matrix P, we obtain 


P- Pu Piz) _ -3 5 
pa Pz 5 10 
By applying the Sylvester criterion for positive definiteness, we find that matrix P is not 
positive definite. Therefore, the origin (equilibrium state) is not stable. 


The instability of the equilibrium state can, of course, be determined by the z 
transform approach. Let us first eliminate X; from the state equation. Then we have 


Xi(k + 2) — 2.85(k + 1) + 1.6%1(k) = 0 
The characteristic equation for the system in the z plane is 
z -2.82+16=0 
or 
(z — 2)(z — 0.8) = 0 
Hence, 
z=2, z=0.8 


Since pole z = 2 is located outside the unit circle in the z plane, the origin (equilibrium 
state) is unstable. 


PROBLEMS 


Problem B-5-1 


Obtain a state-space representation of the following pulse-transfer-function system in 
the controllable canonical form. 

Y2)  z?-2z? 

U(z) 1+ 4271 32^ 


Problem B-5-2 


Obtain a state-space representation of the following pulse-transfer-function system in 
the observable canonical form. 

Y(z) _ z744z^? 

U(z 1-*62?-1lz"7-62^? 


Problem B-5-3 


Obtain a state-space representation of the following pulse-transfer-function system in 
the diagonal canonical form. 

Y) 1+ 6z7' + 827? 

U(z) 1+ 427! + 327? 
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Problem B—5-4 
Obtain a state-space representation of the system described by the equation 
y(k 2) + y(k + 1) + 0.16y(k) = u(k + 1) + 2u(k) 
Problem B-5-5 


Obtain the state equation and output equation for the system shown in Figure 5-11. 


Figure 5-11 Block diagram of a control system. 


Problem B-5-6 

Obtain the state equation and output equation for the system shown in Figure 5-12. 
Problem B-5-7 

Obtain the state-space representation of the system shown in Figure 5-13. 
Problem B-5-8 


Figure 5-14 shows a block diagram of a discrete-time multiple-input-multiple-output 
system. Obtain state-space equations for the system by considering xi(k), x;(k), and 
X3(k) as shown in the diagram to be state variables. Then define new state variables such 
that the state matrix becomes a diagonal matrix. 


Problem B-5-9 
Obtain the state equation and output equation for the system shown in Figure 5-15. 
Problem B-5-10 


Obtain a state-space representation of the discrete-time control system shown in 
Figure 5-16. 
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Figure 5-12 Block diagram of a control system. 


ulk) x(k) X2(k) 


Figure 5-13 Block diagram of the control system of Problem B-5-7. 


Problem B-5-11 


Obtain a state-space representation of the following system in the diagonal canonical 
form. 

Y(z) _ zi +2z7? 

U(z) 14 0.7z7' + 0.1227? 


Problem B-5-12 
Obtain a state-space representation of the following pulse-transfer-function system such 
that the state matrix is a diagonal matrix: 
240 P ko 
U(z) (z + 1)(z + 2)(z + 3) 


Then obtain the initial state variables x,(0), x2(0), and x3(0) in terms of y(0), y(1), 
and y(2). 
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Figure 5-14 Block diagram of the discrete-time multiple-input-multiple-output 
system of Problem B-5-8. 


u(k) 


Figure 5-15 Block diagram of a control system. 
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Y(s) 


Figure 5-16  Discrete-time control system. 


Problem B-5-13 
A state-space representation of the scalar difference equation system 
y(k +n) + a(K)y(k +n — 1) +--+ + a (K)y(K) 
= b(k)u(k + n) + bi(k)u(k + n — 1) +--+ + b.(k)u(k) 
where k — 0,1,2,..., may be given by 


x(k + 1) 0 1 e 0 0 x(k) h(k) 
x(k +1) 0 0 s 0 0 x(k) h(k) 
: =| : : : : > Jaf 5 luc) 
xsa(k +1) 0 0 s 0 1 dxeXK)| | hnk) 
xn(k + 1) —a(k) ~Gna(k) +++ —aXk) —a(k) || x(k) h, (Kk) 


y(k) = xi(k) + bo(k — n)u(k) 


Determine /n(K), ho(k),...,An(k) in terms of a((k) and bj(k), where i = 1,2,...,n 
and j = 0,1,...,n. Determine also the initial values of the state variables x,(0), 
x2(0),...,xn(0) in terms of the input sequence u(0), u(1), ... ,u(n — 1) and the output 
sequence y(0), y(1),..., y(n — 1). 


Problem B-5—14 


If the minimal polynomial of an n x n matrix G involves only distinct roots, then the 
inverse of zI — G can be given by the following expression: 


gI- Gy = X —Ž- (5-145) 
k=12 7 Zk 


where m is the degree of the minimal polynomial of G and the X,'s are n X n matrices 
determined from 


£(G) = gí(z)Xi + gi(22)X2 + +++ + Bj(Zm)Xm 
where 
g(G -(G-zD'' g(z2)-(-2z)" 


where j = 1,2,...,m and z, is any one of the roots of the minimal polynomial of G. 
Using Equation (5-145), obtain (zI — G)^' for the following 2 x 2 matrix G: 


UE 
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Problem B-5-15 
Obtain the pulse transfer function of the system defined by the equations 
x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) + Du(k) 


where 
—-a, -a ~@ 1 
G=] 1 0 0 |, H=/0 
0 1 0 0 


C = [b; — ai bo: b2 — az bo: bz — abo], D = bo 
Problem B-5-16 
Find the pulse transfer function of the system defined by 
x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) + Du(k) 


where 


—a, 1 0 hi 
G=|-a@ 0 1|, H-2|h 

—5 0 0 hy 
C=[1 0 0, D = bo 


Problem B—5-17 


Obtain a state-space representation for the system defined by the following pulse-trans- 
fer-function matrix: 


1 1+2z7 


Y,(z) z 1-;! 1-27 U,(z) 
EG) | 1 + zt | lz) 
1+0.6z7' 1+0.6z! 


Problem B-5-18 
Consider the discrete-time state equation 
eel 0 d d 
x(k + 1) —0.24 -1]| x(k) 
Obtain the state transition matrix W(x). 
Problem B—-5-19 
Consider the system defined by 
x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) + Du(k) 


where matrix G is a stable matrix. 
Obtain the steady-state values of x(k) and y(k) when u(k) is a constant vector. 


Problem B-5-20 
Consider the system defined by 
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x(k + 1) = Gx(k) 


where G is a stable matrix. 
Show that for a positive definite (or positive semidefinite) matrix Q 


J = > x*(k)Ox(k) 
k=0 
can be given by 
J = x*(0)Px(0) 
where P = Q + G*PG. 
Problem B-5-21 


Determine a Liapunov function V(x) for the following system: 
xk £1)| |1 —-1.2 || x(k) 
x(k + 1) 05 0 x(k) 
Problem B-5-22 


Determine the stability of the origin of the following discrete-time system: 


xi(k +1) 1 3 olla) 
x(k +1)] =| —-3 -2 -3| x(k) 
x(k + 1) 1 0 Off x(k) 


Problem B—-5—23 


Determine the stability of the origin of the following discrete-time system: 


Be + pp | -| cosT irean] 
—sinT cosT || xx(kT) 


x2((k + 1)T) 
Problem B-5-24 
Consider the system defined by the equations 
xi(k + 1) = x(k) + 0.2x2(k) + 0.4 
x(k + 1) = 0.5x,(k) — 0.5 


Determine the stability of the equilibrium state. 
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Pole Placement and 
Observer Design 


6-1 INTRODUCTION 


In the first part of this chapter we present two fundamental concepts of control 
systems: controllability and observability. Controllability is concerned with the 
problem of whether it is possible to steer a system from a given initial state to an 
arbitrary state: a system is said to be controllable if it is possible by means of an 
unbounded control vector to transfer the system from any initial state to any other 
state in a finite number of sampling periods. (Thus, the concept of controllability 
is concerned with the existence of a control vector that can cause the system's state 
to reach some arbitrary state.) 

Observability is concerned with the problem of determining the state of a 
dynamic system from observations of the output and control vectors in a finite 
number of sampling periods. A system is said to be observable if, with the system 
in state x(0), it is possible to determine this state from the observation of the output 
and control vectors over a finite number of sampling periods. 

The concepts of controllability and observability were introduced by R. E. 
Kalman. They play an important role in the optimal control of multivariable systems. 
In fact, the conditions of controllability and observability may govern the existence 
of a complete solution to an optimal control problem. 

In the second part of this chapter we discuss the pole placement design method 
and state observers. Note that the concept of controllability is the basis for the 
solutions of the pole placement problem and the concept of observability plays an 
important role for the design of state observers. The design method based on pole 
placement coupled with state observers is one of the fundamental design methods 
available to control engineers. If the system is completely state controllable, then 
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the desired closed-loop poles in the z plane (or the roots of the characteristic 
equation) can be selected and the system that will give such closed-loop poles can 
be designed. The design approach of placing the closed-loop poles in the desired 
locations in the z plane is called the pole placement design technique ; that is, in the 
pole placement design technique we feed back all state variables so that all poles of 
the closed-loop system are placed at desired locations. In practical control systems, 
however, measurement of all state variables may not be possible; in that case, not 
all state variables will be available for feedback. To implement a design based on 
state feedback, it becomes necessary to estimate the unmeasurable state variables. 
Such estimation can be done by use of state observers, which will be discussed in 
detail in this chapter. 

The pole placement design process of control systems may be separated into 
two phases. In the first phase, we design the system assuming that all state variables 
are available for feedback. In the second phase, we design the state observer that 
estimates all state variables (or only those that are not directly measurable) that are 
required for feedback to complete the design. 

Note that in the preceding design approach the design parameters are the 
locations of desired closed-loop poles and the sampling period T. (The sampling 
period T effectively determines the settling time for response.) 

In the analysis in this chapter we assume that the disturbances are impulses that 
take place randomly. The effect of such impulses is to change the system state. 
Therefore, a disturbance may be represented as an initial state. It is assumed further 
that the spacing between adjacent disturbances is sufficiently wide that any response 
to such a disturbance settles down before the next disturbance takes place, so the 
system is always ready for the next round. 

Although our concern in this chapter is primarily with the regulator problem, 
we discuss control problems also. Our problem is to reduce the error vector to zero 
with sufficient speed. In both the regulator problem and control problem the pole 
placement formulation of the design boils down to the determination of the desired 
state feedback gain matrix. The procedure for determining the state feedback gain 
matrix is first to select suitable locations for all closed-loop poles and then to 
determine the state feedback gain matrix that yields the specified closed-loop poles 
so that the errors due to disturbances or command inputs can be reduced to zero with 
sufficient speed. In the final state of the design process the state feedback is 
accomplished by use of the estimated state variables rather than the actual state 
variables, which are probably not available for direct measurement. If some of the 
state variables are measurable, then we may use those available state variables and 
use estimated state variables for those not actually measurable. 

In the last part of this chapter we treat a servo design problem that uses integral 
control coupled with the pole placement technique and the state observer. Note that 
in the regulator problem we desire to transfer the nonzero error vector (due to 
disturbance) to the origin. In the servo problem, we require the output to follow the 
command input. Note that the servo system must follow the command input and at 
the same time must solve any regulator problem. Consequently, in the design of a 
servo system we may begin with the design of a regulator system and then modify 
the regulator system to a servo system. 
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Outline of the Chapter. Section 6-1 has presented an introduction to the 
material to be presented in this chapter. Section 6—2 discusses the controllability of 
linear time-invariant control systems. Section 6-3 treats the observability of such 
systems. Section 6—4 reviews useful transformations in state-space analysis and 
design that we shall use in the remaining sections of this chapter. The basic state- 
space design method is presented in Sections 6—5 and 6—6. Section 6—5 presents the 
pole placement method, the first phase of the design. In the pole placement method 
we assume that all state variables can be measured and are available for feedback. 
Section 6—6 discusses the second phase of the design, the design of state observers 
that estimate the state variables that are not actually measurable. Estimation is based 
on the measurements of the output and control signals. The estimated state variables 
can be used for state feedback based on the pole placement design. The final section, 
Section 6—7, treats servo systems and discusses the design of such systems; the section 
concludes with a design example. 


6-2 CONTROLLABILITY 


A control system is said to be completely state controllable if it is possible to transfer 
the system from any arbitrary initial state to any desired state (also an arbitrary state) 
in a finite time period. That is, a control system is controllable if every state variable 
can be controlled in a finite time period by some unconstrained control signal. If any 
state variable is independent of the control signal, then it is impossible to control 
this state variable and therefore the system is uncontrollable. 

The solution to an optimal control problem may not exist if the system con- 
sidered is not controllable. Although most physical systems are controllable, the 
corresponding mathematical models may not possess the property of controllability. 
Therefore, it is necessary to know the condition under which a system is controllable. 
We shall see later in Section 6—5 that the concept of controllability plays an important 
role in arbitrary pole placement of control systems. Now we shall derive this condi- 
tion in the following. 


Complete State Controllability for a Linear Time-Invariant Discrete-Time Control 
System. Consider the discrete-time control system defined by 


x((k + 1)T) = Gx(kT) + Hu(kT) (6-1) 


where 
x(kT) = state vector (n-vector) at Ath sampling instant 


u(kT) = control signal at kth sampling instant 
G =n X n matrix 
H =n X 1 matrix 
T — sampling period 


We assume that u(kT) is constant for kT = t < (k + 1)T. 
The discrete-time control system given by Equation (6-1) is said to be com- 
pletely state controllable or simply state controllable if there exists a piecewise- 
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constant control signal u(kT) defined over a finite number of sampling periods such 
that, starting from any initial state, the state x(kT) can be transferred to the desired 
state x,in at most n sampling periods. (In discussing controllability, the desired state 
x, may be specified as the origin, or x, = 0. See Problem A-6-1. Here, however, 
we assume that x, is an arbitrary state in the n-dimensional space, including the 
origin.) 

Using the definition just given, we shall now derive the condition for complete 
state controllability. Since the solution of Equation (6—1) is 


x(nT) = G"x(0) + > G" Hu(jT) 


= G'x(0) + G"' Hu(0) + G° Hu(T) + --- + Hu((n — 1)T) 


we obtain 
u((n — 1))T) 
x(nT) — G"x(0) = [H:GH!---:G"'Hy] C 7 27) (6-2) 
u(0) 
Since H is an n X 1 matrix, we find that each of the matrices H, GH,... , G" H is 
an n X 1 matrix or column vector. If the rank of the following matrix is n, or 
rank [H : GH:-:-:G"'!H]- n (6-3) 
then n vectors H, GH,..., G" ' H can span the n-dimensional space. The matrix 


is commonly called the controllability matrix . (Note that all states that can be reached 
from the origin are spanned by the columns of the controllability matrix.) Thus, if 
the rank of the controllability matrix is n, then for an arbitrary state x(nT) = x;, 
there exists a sequence of unbounded control signals u(0),u(T),...,u((n — 1)T) 
that satisfies Equation (6-2). Hence, the condition that the rank of the controllability 
matrix be n gives a sufficient condition for complete state controllability. 

To prove that Equation (6—3) is also a necessary condition for complete state 
controllability, let us assume that 


Then, by use of the Cayley-Hamilton theorem, it can be shown that, for an arbitrary 
i, G'H can be expressed as a linear combination of H, GH,...,G"^! H. Conse- 
quently, we have for any i 


and so the vectors H, GH,..., G^! H cannot span the n-dimensional space; and 
therefore, for some x;, it is not possible to have x(iT) = x, for all i. Thus, the con- 
dition given by Equation (6-3) is necessary. Consequently, we find the rank 
condition given by Equation (6—3) to be a necessary and sufficient condition for 
complete state controllability. 
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If the system defined by Equation (6-1) is completely state controllable, then 
it is possible to transfer any initial state to any arbitrary state in at most n sampling 
periods. Note, however, that this is true if and only if the magnitude of u(KT) is 
unbounded. If the magnitude of u(kT) is bounded, it may take more than n sampling 
periods. (See Problem A-6-2.) 


Complete State Controllability in the Case Where u(kT) Is a Vector. If the 
system is defined by 


x((k + 1)T) = Gx(kT) + Hu(kT) 


where x(kT) is an n-vector, u(kT) is an r-vector, G is an n X n matrix, and H is an 
n X r matrix, then it can be proved that the condition for complete state controllabil- 
ity is that the n X nr matrix 


be of rank n, or that 


Determination of Control Sequence to Bring the Initial State to a Desired 
State. If the matrix 


is of rank n and u(KT) is a scalar, then it is possible to find n linearly independent 
scalar equations from which a sequence of unbounded control signals u(kT) 
(k = 0,1,2,...,n — 1) can be uniquely determined such that any initial state x(0) 
is transferred to the desired state in n sampling periods. See Equation (6—2). 

Note also that, if the control signal is not a scalar but a vector, then the 
sequence of u(kT) is not unique. Then there exists more than one sequence of 
control vector u(kT) to bring the initial state x(0) to a desired state in not more than 
n sampling periods. 


Alternative Form of the Condition for Complete State Controllability. | Consider 
the system defined by 


x((k + 1)T) = Gx(kT) + Hu(kT) (6-4) 
where 
x(kT) = state vector (n-vector) at kth sampling instant 
u(kT) = control vector (r-vector) at kth sampling instant 
G =n X n matrix 
H = n X r matrix 
T = sampling period 


If the eigenvectors of G are distinct, then it is possible to find a transformation matrix 
P such that 
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0 An 
Note that if the eigenvalues of G are distinct then the eigenvectors of G are distinct. 
However, the converse is not true. (For example, an n X n real symmetric matrix 
having multiple eigenvalues has n distinct eigenvectors.) Note also that the ith 


column of the P matrix is an eigenvector of G associated with ith eigenvalue A; 
(i = 1,2,...,n). Let us define 


x(kT) = P&(KT) (6-5) 


Substituting Equation (6-5) into Equation (6-4), we obtain 


&((k + 1)T) = P~ GP&(KT)) + P' Hu(kT) (6-6) 
Let us define 
fu fu erp fir 
P'H=F= fa fa fus f 
hao heo] £f 


Then, Equation (6—6) may be written as follows: 


E(k + 1)T) = ALE£KT) + faulkT) + fio uXKkT) + +++  fiu(kT) 
XX((k t 1)7) = Ap £2(kT) + fa u(kT) t fo u(kT) +e + foru (kT) 


Ek + 1)T) = AL£(kT) + far (KT)  fowX(kT) + +++ + fu (kT) 


If the elements of any one row of the n x r matrix F are all zero, then the cor- 
responding state variable cannot be controlled by any of the u,(kT). Hence, the 
condition for complete state controllability is that, if the eigenvectors of G are 
distinct, then the system is completely state controllable if and only if no row of P^! H 
has all zero elements. It is important to note that to apply this condition for complete 
state controllability we must put the matrix P^! GP in Equation (6—6) into diagonal 
form. 

If the G matrix in Equation (6—4) does not possess distinct eigenvectors, then 
diagonalization is impossible. In such a case, we may transform G into a Jordan 
canonical form. If, for example, G has eigenvalues Aj, Ay, A1, Ag, Ag, Ag, . .. , A, and has 
n — 3 distinct eigenvectors, then the Jordan canonical form of G is 
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à 1 0j 0 
0 A 1! 

090: . 
PESE 

= 0 Asi 

J= TAs 0 
| 

0 F dn | 


The 3 x 3 and 2 x 2 submatrices on the main diagonal are called Jordan blocks. 
Suppose it is possible to find a transformation matrix S such that 


S'GS=J 
If we define a new state vector X by 
X(kT) = S&(KT) (6—7) 


then substituting Equation (6—7) into Equation (6—4) gives 
&((k + 1)T) = S'! GS&(kT) + S! Hu(kT) 
= J&(KT) + S'! Hu(KT) (6-8) 


The conditions for the complete state controllability of the system of Equation (6-8) 
may then be stated as follows: The system is completely state controllable if and only 
if (1) no two Jordan blocks in J of Equation (6-8) are associated with the same 
eigenvalues, (2) the elements of any row of S! H that corresponds to the last row 
of each Jordan block are not all zero, and (3) the elements of each row of S! H that 
correspond to distinct eigenvalues are not all zero. 


Comments. In the preceding conditions for state controllability, it is stated 
that no two Jordan blocks in J of Equation (6-8) should be associated with the 
same eigenvalues. This point is elaborated as follows. 

Consider the following system where the two Jordan blocks are associated with 
the same eigenvalues A,: 


x(k + 1) à! 0 0 |[ x(k) 1 
E + i = H à 3E + A 
x(k + 1) 0:0 A, || x(k) 1 


Although every state variable is affected by u(x), this system is uncontrollable, since 
the rank of the controllability matrix 


1 Ài X? 
[H: GH: GH] 2 |1 à+1 Az +2 
1 Ài Al 


is 2. Hence, in applying the preceding criterion for state controllability, no two 
Jordan blocks in J of Equation (6—8) should be associated with the same eigenvalues. 
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Example 6-1 


The following systems are completely state controllable: 


2l f- ouk 2 
i Für + l P | 0 E t [2 «coi 


x(k + 1) -2 1 o9 0 || x(k) 0 1 
x(k + 1) 0 -2 ua x(k) 0 0 k 
2o xGo D-90724 e x(k)|*|3 0 Ea 
x(k +1) ETT] x()| fo ofle 
xs(k + 1) 0 1 O 5] xs(k) 2L 
The following systems are not completely state controllable: 
x(k*1)| |-1 Ojj x(k) 2 
b Bs + P| | 0 sun tio [u(k)] 
x(k + 1) 22 d. 701 0 || xi(K) 0 1 
xXk + 1) 0 -2 1 x(k) 3 0 (k 
2. | xs(k + 1)| = _0 0 -2! PIRE x(k)|-]0 0 fa] 
xa(k + 1) 1-5 i| x(k) Ze 
xs(k + 1) 0 1! 0 —5]| xs(k) 0 0 


Condition for Complete State Controllability in the z Plane. The condition for 
complete state controllability can be stated in terms of pulse transfer functions. 

A necessary and sufficient condition for complete state controllability is that 
no cancellation occur in the pulse transfer function. If cancellation occurs, the system 
cannot be controlled in the direction of the canceled mode. (See Problem A-6-4.) 


Example 6—2 
Consider the following pulse transfer function: 
Y(z) E z+0.2 
U(z) (z *0.8)(z + 0.2) 


Clearly, cancellation of factors (z + 0.2) in the numerator and denominator occurs. 
Thus, one degree of freedom is lost. Because of this cancellation, this system is not 
completely state controllable. 

The same conclusion can be obtained, of course, by writing this pulse transfer 
function in the form of state equations. A possible state-space representation for this 


system is 
(k-1| | 0 1 || x(k) 1 
P + i = ET EE B ENT 
y(k) = [i af 200) | 
Since 


miom-[ js a 


the rank of [H : GH] is 1. Therefore, we arrive at the same conclusion: that the system 
is not completely state controllable. 
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Complete Output Controllability. In the practical design of a control sys- 
tem, we may want to control the output rather than the state of the system. Complete 
state controllability is neither necessary nor sufficient for controlling the output of 
the system. For this reason, it is necessary to define separately complete output 
controllability. 

Consider the system defined by the equations 


x((k + 1)T) = Gx(kT) + Hu(kT) (6-9) 
y(kT) = Cx(kT) (6-10) 
where 
X(kT) = state vector (n-vector) at kth sampling instant 


u(kT) — control signal (scalar) at kth sampling instant 
y(kT) = output vector (m-vector) at kth sampling instant 
G =n X n matrix 
H =n X 1 matrix 
C =m X n matrix 


The system defined by Equations (6-9) and (6-10) is said to be completely output 
controllable, or simply output controllable, if it is possible to construct an uncon- 
strained control signal u(kT) defined over a finite number of sampling periods 
0 = kT < nT such that, starting from any initial output y(0), the output y(kT) can 
be transferred to the desired point (an arbitrary point) y; in the output space in at 
most n sampling periods. 

In what follows we derive the condition for complete output controllability. 
Note that, if a system is completely output controllable, then a piecewise constant 
control signal exists that will transfer any initial output to any desired point y; in the 
output space in at most n sampling periods. Since the solution of Equation (6-9) is 

n-1 


x(nT) = G"x(0) + x G"! Hu(jT) 


we have 
y(nT) = Cx(nT) 
n-1 


= CG"x(0) + È CG"! Hu(jT) 
j=0 


or 
y(nT) — CG"x(0) = 5 CG"7'!Hu(jT) 
= CG" Hu(0) + CG"? Hu(T) + --- + CHu((n — 1)T) 
u((n — 1)T) 
- 2)T) 


u (0) 
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Note that y(nT) — CG"x(0) — y; — CG"x(0) represents an arbitrary point in the 
m-dimensional output space. Thus, as in the case of complete state controllability, 
a necessary and sufficient condition for the system to be completely output control- 
lable is that vectors CH, CGH, . . . , CG" ! H span the m-dimensional output space, 
or that 


rank [CH : CGH: ---:CG""'H] = m (6-11) 


From this analysis it can be seen that, in the system defined by Equations (6-9) and 
(6-10), complete state controllability implies complete output controllability if and 
only if the m rows of C are linearly independent. 

Next, consider the system defined by the equations 


x((k  1)T) = Gx(kT) + Hu(kT) (6-12) 
y(kT) = Cx(kT) + Du(kT) (6-13) 
where 
X(KT) = state vector (n-vector) at kth sampling instant 
u(kT) = control vector (r-vector) at kth sampling instant 
Y(KT) = output vector (m-vector) at kth sampling instant 
G =n X n matrix 
H = n x r matrix 
C =m X n matrix 
D = m x r matrix 


The condition for complete output controllability for this system can be derived as 
follows. Since the output y(nT) can be given by the equation 
y(nT) = Cx(nT) + Du(nT) 
n-1 


= CG"x(0) + È CG" Hu(jT) + Du(nT) 
j-0 


we obtain 


n-l 


y(nT) — CG"x(0) = » CG"! Hu(jT) + Du(nT) 


= CG""'Hu(0) + CG"?Hu(T) + --- + CHu((n — 1)T) 


+ Du(“T) 
u(nT) 
= [D: CH: CGH: -i G7 Hy "n 7 DT) 
u(0) 


A necessary and sufficient condition for the system defined by Equations (6-12) and 
(6-13) to be completely output controllable is that the m x (n + 1)r matrix 
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be of rank m: 
rank [D : CH: CGH: ---:CG""'H] = m (6-14) 


It is noted that the presence of matrix D in the system output equation always helps 
to establish complete output controllability. 


Controllability of a Linear Time-Invariant Continuous-Time Control System. In 
what follows, we shall briefly state the conditions for complete state controllability 
and output controllability of linear time-invariant continuous-time control systems. 
Consider the system defined by 


X = Ax + Bu 
y = Cx + Du 


where 


X = state vector (n-vector) 


u — control vector (r-vector) 


y 7 output vector (m-vector) 


A — n X n matrix 
B =n X r matrix 
C =m X n matrix 
D = m x r matrix 


Complete State Controllability. A necessary and sufficient condition for com- 
plete state controllability for this system can be derived in a way similar to what was 
used in the case of the discrete-time system. Here, we shall present only the result. 

The condition for complete state controllability is that the n X nr matrix 


be of rank n or that it contains n linearly independent column vectors. (This matrix 
is commonly called the controllability matrix for the continuous-time system.) 

The condition for complete state controllability can also be stated in terms of 
transfer functions or transfer matrices. A necessary and sufficient condition for 
complete state controllability is that no cancellation occur in the transfer function 
or transfer matrix. If cancellation occurs, the system cannot be controlled in the 
direction of the canceled mode. 


Output Controllability. As in the case of the discrete-time control system, 
complete state controllability is neither necessary nor sufficient for controlling the 
output of a linear time-invariant continuous-time control system. It can be proved 
that the condition for complete output controllability is that the rank of the 
m X (n + 1)r matrix 


be m. 
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6-3 OBSERVABILITY 


In this section, we shall discuss the observability of linear time-invariant discrete- 
time control systems. Consider the unforced discrete-time control system defined by 


x((k + 1)T) = Gx(kT) (6-15) 
y(KT) = Cx(kT) (6-16) 
where 
x(kT) = state vector (n-vector) at kth sampling instant 
y(kT) = output vector (m-vector) at kth sampling instant 
G =n X n matrix 
C =m x n matrix 


The system is said to be completely observable if every initial state x(0) can be 
determined from the observation of y(kT) over a finite number of sampling periods. 
The system, therefore, is completely observable if every transition of the state 
eventually affects every element of the output vector. 

The concept of observability is useful in solving the problem of reconstructing 
unmeasurable state variables. It will be seen later that state feedback control systems 
designed by the pole placement method will require feedback of weighted state 
variables. In practice, however, the difficulty encountered with state feedback 
control systems is that some of the state variables are not accessible for direct 
measurement. Then it becomes necessary to estimate the unmeasurable state vari- 
ables in order to construct the feedback control signals. In Section 6-6 we shall see 
that the concept of observability plays a dominant role in the design of state 
observers. 

The reason we are considering the unforced system is as follows. If the system 
is described by the equations 


x((k + 1)T) = Gx(kT) + Hu(KT) 
y(kT) = Cx(kT) + Du(kT) 
then 


k-1 


x(kT) = G‘x(0) + > G7" Hu(jT) 


and y(KT) is 
k-1 


y(kT) = CG*x(0) + » CG7^7 Hu(jT) + Du(kT) 


Since the matrices G, H, C, and D are known and u(kT) is also known, the second 
and third terms on the right-hand side of this last equation are known quantities. 
Therefore, they may be subtracted from the observed value of y(kT). Hence, for 
investigating a necessary and sufficient condition for complete observability, it 
suffices to consider the system described by Equations (6-15) and (6-16). 
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Once x(0) can be determined from the observation of the output, x(kT) can 
also be determined, since u(0), u(T), ... ,u((k — 1)T) are known. 


Complete Observability of Discrete-Time Systems. Consider the system defined 
by Equations (6—15) and (6—16). The system is completely observable if, given the 
output y(kT) over a finite number of sampling periods, it is possible to determine 
the initial state vector x(0). 

In what follows we shall derive the condition for the complete observability of 
the discrete-time system described by Equations (6—15) and (6—16). Since the solu- 
tion x(kT) of Equation (6—15) is 


x(kT) = G*x(0) 
we obtain 
y(kT) = CG*x(0) 
Complete observability means that, given y(0), y(T), y(2T), .. . , it is possible to de- 


termine x,(0), x;(0), ...,x,(0). To determine n unknowns, we need only n values of 
y(kT). Hence, we may use the first n values of y(KT), or y(0), y(T), ..., y((n — DT) 
for the determination of x,(0), x0(0), . . . x, (0). 
For a completely observable system, given 
y(0) = €x(0) 


y(T) = CGx(0) 


y((n — 1)T) = CG" 'x(0) 


we must be able to determine x;(0), x.(0), ...,x,(0). Noting that y(kT) is an m 
vector, the preceding n simultaneous equations yield nm equations, all involving 
x,(0), x2(0), . . . ,X,(0). To obtain a unique set of solutions x,(0), x(0), . . . , x, (0) from 
these nm equations, we must be able to write exactly n linearly independent equa- 
tions among them. This requires that the nm X n matrix 


be of rank n. 

Noting that the rank of a matrix and that of the conjugate transpose of the 
matrix are the same, it is possible to state the condition for complete observability 
as follows. A necessary and sufficient condition for the system defined by Equa- 
tions (6—15) and (6—16) to be completely observable is that the rank of the n X nm 
matrix 


[C*: G*C* :---:(G*)"! C*] (6-17) 


be n. The matrix given by (6—17) is commonly called the observability matrix . [Note 
that in (6-17), asterisks indicate conjugate transposes. If matrices C and G are real, 
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then the conjugate transpose notation such as G*C* may be changed to the transpose 
notation such as G7C".] 


Alternative Form of the Condition for Complete Observability. Consider the 
system defined by Equations (6-15) and (6—16), repeated here: 


x((k + 1)T) = Gx(kT) (6-18) 
y(kT) = Cx(kT) (6-19) 


Suppose the eigenvalues of G are distinct, and a transformation matrix P transforms 
G into a diagonal matrix, so that P^! GP is a diagonal matrix. Let us define 


X(kT) = P£&(kT) 
Then Equations (6-18) and (6-19) can be written as follows: 
X((k + 1)T) = P! GP£(KT) 
y(kT) = CP&(KT) 


Hence, 
y(nT) = CP(P^ GP)" £(0) 
or 
M Ar ¥,(0) 
ynr)-cpe| M &(0) = cp| ^50) 
M, At, (0) 
where A;,A2,...,A, are n distinct eigenvalues of G. The system is completely 


observable if and only if none of the columns of the m x n matrix CP consists of 
all zero elements. This is because, if the ith column of CP consists of all zero 
elements, then the state variable £;(0) will not appear in the output equation and 
therefore cannot be determined from observation of y(kT). Thus, x(0), which is 
related to &(0) by the nonsingular matrix P, cannot be determined. 

If the matrix G involves multiple eigenvalues and cannot be transformed into 
a diagonal matrix, then by using a suitable transformation matrix S we may transform 
G into the Jordan canonical form: 


S'GS=J 
where J is in the Jordan canonical form. Let us define 
x(KT) = S&(kT) 
Then Equations (6-18) and (6-19) can be written as follows: 
K((k + 1)T) = S'GS&(KkT) = J&(kT) 
y(kT) = CSX(KT) 
Hence, 


y(nT) = CS(S~'GS)"X(0) 
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The system is completely observable if and only if (1) no two Jordan blocks in J are 
associated with the same eigenvalue, (2) none of the columns of CS that corresponds 
to the first row of each Jordan block consists of all zero elements, and (3) no columns 
of CS that correspond to distinct eigenvalues consist of all zero elements. 

To clarify condition 2, in Example 6-3, which follows, we have enclosed in 
dashed lines the columns of CS that correspond to the first row of each Jordan block. 


Example 6—3 


The following systems are completely observable. 


x(* 0n] [-1 ofnar) ou og n(ET) 
E Bese je ee yD) = S ud 


x(k-nn| |21 0 0 | xi(kT) 
x2((k  1)T) 0 2 1 xXKkT) 
2. |x((k - DT)| 2]0 0 2 x3(kT) 


xd. rues E 37 T || xa(kT) 


3 
x(k +1)T)} |0 0 -3] x«(&T) 
x(kT) 

sen] [m 11 3 d] ED 
be E To. j MED 
xs(kT) 


The following systems are not completely observable: 


((k+ DT)|_|-1 0O[x(kT) " (kT) 
L Baral 0 E Bron y(kT) = [0 T 20] 


x((k-1T)| |2 1 0 0 || xi(kT) 
xX(k-1T)| |0 2 1 x2(kT) 
2. |x((k + DT)| -|0 0 2 x3(kT) 


x(k +1)T)} | j -3 j 1 || xa(kT) 


3 
x(k + D| |0 0 -3]| xs(kT) 
xi(kT) 
»(&r)] [ma 15 1] 8D 
Ba [i 1 1101 3 x 
xs(kT) 


Condition for Complete Observability in the z Plane. The condition for com- 
plete observability can also be stated in terms of pulse transfer functions. A necessary 
and sufficient condition for complete observability is that no pole-zero cancellation 
occur in the pulse transfer function. If cancellation occurs, the canceled mode cannot 
be observed in the output. 


Example 6-4 


Show that the following system is not completely observable: 
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x((k + 1)T) = Gx(kT) + Hu(kT) 
y(kT) = Cx(kT) 


where 
0 1 0 0 
G- 0 0 1|, H =| 0}, C-[4 5 1] 
—6 -11 -6 1 


Note that the control signal u(kT) does not affect the complete observability of the 
system. To examine complete observability, we may simply set u(kT) — 0. For this 
system, we have 


4 —6 6 
[C*:G*C*:(G* C] 2|5 -7 5 
1 -1 -1 
Notice that 
4 -6 6 
5 -7 5| 20 
1 -1 -1 


Hence, the rank of the matrix [C* : G*C* : (G9)? C*] is less than 3. Therefore, the 
System is not completely observable. 

In fact, in this system a pole-zero cancellation occurs in the pulse transfer function 
of the system. The pulse transfer function between X,(z) and U(z) is 


X2) | 1 
U(z) (z-1)z-2)z-3) 


and the pulse transfer function between Y (z) and Xi(z) is 


YG) 
=(z+ 
Xz) (z+ 1) + 4) 
Therefore, the pulse transfer function between output Y(z) and input U(z) is 
Y(z) _ (z + 1)(z + 4) 


U(z) (z + Iz + 2Y(z + 3) 


Clearly, the (z + 1) factors in the numerator and denominator cancel each other. This 
means that there are nonzero initial states x(0) that cannot be determined from the 
measurement of y (KT). 


Comments. ‘The pulse transfer function has no cancellation if and only if the 
system is completely state controllable and completely observable. (See Problem 
A-6—4.) This means that a canceled transfer function does not carry along all the 
information characterizing the dynamic system. 


Principle of Duality. In what follows, we shall examine the relationship 
between controllability and observability. Consider the system S, defined by the 
equations 


x((k + 1)T) = Gx(kT) + Hu(kT) (6-20) 
y(kT) = Cx(kT) (6-21) 


= 
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where 
X(kT) = state vector (n-vector) at Ath sampling instant 
u(kT) — control vector (r-vector) at kth sampling instant 
y(kT) = output vector (m-vector) at kth sampling instant 
G =n X n matrix 
H = n x r matrix 
C =m X n matrix 
and its dual counterpart, which we call system S,, defined by the equations 
&((k + 1)T) = G*X(KT) + C*ü(KT) (6-22) 
y(kT) = H*X(KT) (6-23) 
where 
%(kT) = state vector (n-vector) at kth sampling instant 
ü(kT) = control vector (m-vector) at kth sampling instant 
$(kT) = output vector (r-vector) at kth sampling instant 
G* = conjugate transpose of G 
H* = conjugate transpose of H 
C* = conjugate transpose of C 


We shall now examine an analogy between controllability and observability. This 
analogy is referred to as the principle of duality, due to Kalman. 

The principle of duality states that system S, defined by Equations (6-20) and 
(6—21) is completely state controllable (observable) if and only if system 5; defined 
by Equations (6—22) and (6—23) is completely observable (state controllable). To 
verify this principle, let us write down the necessary and sufficient conditions for 
complete state controllability and complete observability for systems S; and 5;, 
respectively. 


FOR SYSTEM 5$;: 


1. A necessary and sufficient condition for complete state controllability is that 


FOR SYSTEM $;: 


1. A necessary and sufficient condition for complete state controllability is that 
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2. A necessary and sufficient condition for complete observability is that 


By comparing these conditions, the truth of the principle of duality is apparent. 


We see that system S, being completely state controllable is equivalent to 
system S, being completely observable. And system S, being completely observable 
is equivalent to system Sz being completely state controllable. By use of this princi- 
ple, the observability of a given system can be checked by testing the state control- 
lability of its dual. 


Complete Observability of Linear Time-Invariant Continuous-Time Control Sys- 
tems. Finally, we shall briefly state the complete observability condition for the 
linear time-invariant continuous-time control system. The system is said to be 
completely observable if every initial state x(0) can be determined from the obser- 
vation of y(t) over a finite time interval. Similar to the case of the discrete-time 
control system, we need to consider only an unforced system. Consider the system 
defined by the equations: 


X = Ax 
y = Cx 
where 


It 


x = state vector (n-vector) 


y = output vector (m-vector) 
A =n Xx n matrix 
C =m X n matrix 


As in the case of the discrete-time control system, it can be stated that the condition 
for complete observability is that the rank of the n X nm matrix 


be n. (This n x nm matrix is commonly called the observability matrix for the 
continuous-time system.) 


Effects of the Discretization of a Continuous-Time Control System on Control- 
lability and Observability. When a continuous-time control system with complex 
poles is discretized, the introduction of sampling may impair the controllability and 
observability of the resulting discretized system. That is, pole—zero cancellation may 
take place in passing from the continuous-time case to the discrete-time case. Thus, 
the discretized system may lose controllability and observability. 

It can be shown that a system that is completely state controllable and com- 
pletely observable in the absence of sampling remains completely state controllable 
and completely observable after the introduction of sampling if and only if, for every 
eigenvalue of the characteristic equation for the continuous-time control system, the 
relationship 


Re Ài = Re Àj (6-24) 
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implies 
2 
Im (A; — A) + > (6-25) 
where T is the sampling period and n = +1,+2,.... It is noted that, unless the 


system contains complex poles, pole-zero cancellation will not occur in passing from 
the continuous-time to the discrete-time case. 


Example 6-5 


Consider the following continuous-time control system: 


Leah oem 
y=[l az (6-27) 


This system is completely state controllable and completely observable, since the rank 
of the controllability matrix 
. (10 1 
mian- [2 1 


is 2 and the rank of the observability matrix 
[C* : A*C*] = | 1 | 
is also 2. Notice that the eigenvalues of the state matrix are 
Ai =f, à: = >j 
The discrete-time control system obtained by discretizing the continuous-time control 
system defined by Equations (6-26) and (6-27) may be given as follows: 
E + 2n) _ | cos T zen + | — cos T 


jen (6-28) 


x2((k + 1)T) —sinT cosT || x(kT) sin T 
y(kT) = [1 af 24D | (6-29) 


where T is the sampling period. 
Let us show that the discretized system given by Equations (6-28) and (6-29) is 
completely state controllable and completely observable if and only if 


Im (ài - Aa) = 1214 277 


or 
T * nm, n=1,2,3,... 
For the discrete-time control system obtained by discretizing the continuous-time 


control system, we have the following controllability matrix: 


. _|1-cosT cosT*1-2cos?T 
[H : GH] = | sinT  —sinT + 2 cosT sin z 
Notice that the rank of [H : GH] is 2 if and only if T # nm (wheren = 1,2,3,... ). Also, 


the rank of the observability matrix 
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[C*:G*C*] = | cos r 


0 sinT 
is 2 if and only if T + na (where n = 1,2,3,...). 

From the foregoing analysis, we conclude that the discretized system is completely 
state controllable and completely observable if and only if T # nm, where n = 1, 
2,3,.... 

Note that it is always possible to avoid the loss of controllability and observability 
by choosing a sampling period T not equal to rn. 


6-4 USEFUL TRANSFORMATIONS IN STATE-SPACE ANALYSIS 
AND DESIGN 


In this section we shall first review techniques for transforming state-space equations 
into canonical forms. Then we shall review the invariance property of the rank 
conditions for the controllability matrix and observability matrix. 


Transforming State-Space Equations Into Canonical forms. Consider the dis- 
crete-time state equation and output equation 


x(k + 1) = Gx(k) + Hu(k) (6-30) 
y(k) = Cx(k) + Du(k) (6-31) 


We shall review techniques for transforming the state-space equations defined by 
Equations (6-30) and (6-31) into the following three canonical forms: 


1. Controllable canonical form 
2. Observable canonical form 
3. Diagonal or Jordan canonical form 


(Note that the diagonal canonical form is a special case of the Jordan canonical 
form.) It is assumed that the system defined by Equations (6-30) and (6-31) is 
completely state controllable and completely observable. 


Controllable Canonical Form. The system defined by Equations (6-30) and 
(6-31) can be transformed into a controllable canonical form by means of the 
transformation matrix 


T = MW (6—32) 
where 
M = [H:GH:---:G""H] (6-33) 
and 
Gp 04 ccc 0 1 
G2 43 c: 1 0 
W-|: : : (6-34) 
a 1 >. 0 0 
1 0 >= 0 0 
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The elements a; shown in matrix W are coefficients of the characteristic equation 
lzI — G| = z” + az" + e + aaz +a =O 
It can be shown that 


TGT = (MW) G(MW) = W!M^GMW 


0 1 0 e 0 
0 0 1 68 0 
=| i: (6-35) 
0 0 0 1 
Tân —s-i An-2 ~ay 
and 
0 
0 
TH =|: (6-36) 
0 
1 


(For details of the derivations of the preceding two equations, see Problems A-6—5 
and A-6-6.) 
Now let us define 


x(k) = T&(k) 


where the transformation matrix T is given by Equation (6-32). Then Equations 
(6-30) and (6-31) become 


£(k + 1) = T GT&(k) + T^ Hu(k) = G&(k) + Hu(k) 
y(k) = CT&(k) + Du(k) = C&(k) + Du(k) 
where G = TGT, H = TH, C = CT, and D = D, or 


Xi(k + 1) 0 1 0 ate ocn £k) 0 
E£XKk + 1) 0 0 1 es T X2(k) 0 
=| i: to | +]: lute) 

£n-1(k + 1) 0 0 0 e 1 qEESZa(Ck) 0 
£,(k + 1) 74, an3 —442 c || £(K) 1 

(6-37) 
&() 

y(k) T [bn — a, bo: b, a Qn-1 bo: D : b, 7 ay bo] aU + Du(k) 

£,(k) 

(6-38) 


where the b,'s are those coefficients appearing in the numerator of the following 
pulse transfer function: 
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CGI- G)?H«D-€(z1- G)' Ê + D 


_ boz” + biz" ot baz + b, 
z” + az! +--+ aizta 


(6-39) 
Note that D = D = by. The system given by Equations (6-37) and (6-38) is in a 
controllable canonical form. 

Observable Canonical Form. The system defined by Equations (6—30) and 


(6—31) can be transformed into an observable canonical form by means of the 
transformation matrix 


Q = (WNS) 
where 
N = [C* : G*C*: -i (G*) -1 C*] (6—40) 
and W is given by Equation (6-34). It can be shown that 
0 0 -> 0 ca, 
. 10-0 -a4 
Q'GQ-G- 0 1-0 7a. 
00-1 -a 
b, — a,b 
Q"H- i= b, Abo 
b, — abo 
and 
cg=C=[0 O --- 0 1] 


where the b, 's are those coefficients appearing in the numerator of the pulse transfer 
function given by Equation (6—39). (For details of the derivations of the preceding 
equations, see Problems A-6-8 and A-6-9.) Hence, by defining 


x(k) = Q&(k) 

Equations (6-30) and (6-31) become as follows: 
&(k + 1) = G&(k) + Hu(k) 
y(k) = €&(k) + Du(k) 


or 
a(k+1)] [00--- 0 -a T &Q) b, — a, by 
XX(k + 1) 10-0 —gs-1 XX(K) b, — An-1 bo 
=/:: oo] > |+ : u(k) (6-41) 
X, (Kk + 1) 00- 0 Ta, Xn—-1(k) b; — a bo 
00- 1 -a 


X,(k + 1) X,(k) bi —4 bo 
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£(k) 
£,(k) 
y(k)=[0 0 =- O 1] : | + Dulk) (6-42) 
£,-1(k) 
&(k) 


The system defined by Equations (6-41) and (6—42) is in an observable canonical 
form. 


Diagonal or Jordan Canonical Form. If the eigenvalues p; of matrix G are 


distinct, then the corresponding eigenvectors &,, &, . . . , £, are distinct. Define the 
transformation matrix P as follows: 
P- ot 
Then 
p 0 0 
pGp-|? P 0 
00 p, 
Thus, if we define 
x(k) = P&(K) 
then Equations (6-30) and (6-31) can be given by the equations 
&(k + 1) = Gi(k) + Hu(k) (6-43) 
y(k) = €&(k) + Du(k) (6-44) 


where G = P^! GP, H = P! H, € = CP, and D = D. Thus, Equations (6-43) and 
(6—44) can be written in the form 


Xi(k + 1) Pi 0 ttt 0 EK) a 
MKS D) 70 pos Of HY) pm yey (eas 
skn] [0 0 -- pé] lo, 

¥,(k) 


yk) = [8 & -- g) 9 


— 


+ Du(k) (6-46) 
¥n(k) 
where the o;'s and the fj;'s are constants such that a; f; is the residue at the pole 


z = pi, that is, such that o; B; will appear in the numerator of the term 1/(z — p;) 
when the pulse transfer function is expanded into partial fractions as follows: 


C(zI - G)'H+ D = Ĉ(zI - Ĝ)' Ê + Ô 


= Pi, ey 


+B + py ^ (6-47) 
Z— pi Z— po Z — Dn 
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In many cases we choose a, = œ = ::: = a, = 1. [Note that the necessary and 
sufficient condition for the system to be completely state controllable is that a; # 0 
(i = 1,2,...,n) and that the condition for it to be completely observable is that 
Bi * 0 (i =1,2,...,n).] 

If there are multiple eigenvalues p; of matrix G, then we choose the transfor- 
mation matrix S defined as follows: 


where the n;’s are eigenvectors (which correspond to distinct eigenvalues) or gen- 
eralized eigenvectors (which correspond to multiple eigenvalues). (For details of 
generalized eigenvectors, see Appendix A.) Then 


S^! GS = matrix in Jordan canonical form 


Now if we define 
x(k) = Sx(k) 

then Equations (6-30) and (6-31) can be given as follows: 

&(k + 1) = G&(k) + Hu(k) 

y(k) = €&(k) + Dü(k) 

where G = S! GS, H = S^! H, € = CS, and D = D. If, for example, matrix G 
involves an m-multiple eigenvalue p; and other eigenvalues p,,+1,Pm+2,---»Pn that 
are all distinct and different from p, and, in addition, if the rank of p; I1 — Gisn — 1 
(which implies that the minimal polynomial is identical to the characteristic poly- 


nomial), then the state-space equations in the Jordan canonical form are given as 
follows: 


[ £k 1) pd 0! 01[ £(k) 0 
£Xk bs 1) Pr 1 | 42(k) 0 
EAD ; 
in(k +1) =| 0 p fn(k) | + | an ulk) 
Ak + 1) ay NM RCM m OO milk) amii 
L&k+n] L0 En EIETO a, 
(6-48) 
£(k) 
y(k) = (BB Ball 9 + Duk) (6-49) 
£,(k) 


where the o;'s and the fj;'s are constants appearing in the pulse transfer function for 
this system: 
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C(zI - G)'H + D = Ĉ(zI - G)'H+ D 


— An Bi Om Bo tee Am Bn 


= L———— Aut 
(z =- p)" (z — pi)" z ->= pi 


Ono Tec On Bn + D 
z= Pm z — Pn 


In many cases we choose a, = Gms, = +++ = a, = 1. [Note that the necessary and 
sufficient condition for the system to be completely state controllable is that o; + 0 
(i = m,m + 1,...,n) and that to be completely observable is that Bi * 0 (i — 1, 
mt+1,m-+2,...,n).] 

Note that if the rank of p,I — G is n — s (where 2 = s = n), that is, if the 
minimal polynomial is s — 1 degree lower than the characteristic polynomial, then 
S^! GS will have a different Jordan canonical form. (For details, see Appendix A.) 


+ 


Invariance Property of the Rank Conditions for the Controllability Matrix and 
Observability Matrix. Consider systems related by similarity transformations. Let 
us define the controllability matrix as M: 


Let P (an arbitrary n X n nonsingular matrix) be a similarity transformation matrix 
and write 


Then 
P'GP-P'GPP'GP-GG- © 
P'GP-P'GPP'GPP'!GP = @ 
P! G^! P= G""! 
Hence, 


= [H: GH:---:G""'H] = M 
Since matrix P is nonsingular, we have 
rank M = rankM 


Similarly, for the observability matrix define 


Let P be an arbitrary n x n nonsingular matrix and write 


P'GP=G, CP-€C 
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Then 
P*N = P*[C* : G*C* i}... i (G9)! C*] 
= [P*C* : P*G*C* :---: P*(G*)'"! C*] 
= [C*: (P! GP)*C* :---: (P^! G"? P)*C*] 
= [c* GC i... i (G) Č*] = Ñ 
Hence, 


rank N = rank Ñ 


6-5 DESIGN VIA POLE PLACEMENT 


In this section we shall present a design method commonly called the pole placement 
or pole assignment technique. We assume that all state variables are measurable and 
are available for feedback. It will be shown that, if the system considered is com- 
pletely state controllable, then poles of the closed-loop system may be placed at any 
desired locations by means of state feedback through an appropriate state feedback 
gain matrix. 

The present design technique begins with a determination of the desired 
closed-loop poles based on transient-response and/or frequency-response require- 
ments such as speed, damping ratio, or bandwidth. Given such considerations, let 
us assume that we decide that the desired closed-loop poles are to be at z = ju, 
Z = B... Z = Hn. (In choosing the sampling period, care must be exercised so 
that the desired system will not require unusually large control signals. Otherwise, 
saturation phenomena will occur in the system. If saturation takes place in the 
system, the system will become nonlinear, and the design method presented here 
will no longer apply, since the method is applicable only to linear time-invariant 
systems.) Then, by choosing an appropriate gain matrix for state feedback, it is 
possible to force the system to have closed-loop poles at the desired locations, 
provided that the original system is completely state controllable. 

In what follows, we shall treat the case where the control signal is a scalar and 
prove that a necessary and sufficient condition that the closed-loop poles can be 
placed at any arbitrary locations in the z plane is that the system be completely state 
controllable. Then we shall discuss a few methods for determining the required state 
feedback gain matrix. 


Necessary and Sufficient Condition for Arbitrary Pole Placement. Consider the 
open-loop control system shown in Figure 6-1(a). The state equation is 


x(k + 1) = Gx(k) + Hu(k) (6-50) 
where 
x(k) = state vector (n-vector) at kth sampling instant 
u(k) = control signal (scalar) at kth sampling instant 
G =n x n matrix 


H =n x 1 matrix 
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(b) 


Figure 6-1 (a) Open-loop control system; (b) closed-loop control system with 
u(k) = —Kx(k). 


We assume that the magnitude of the control signal u(k) is unbounded. If the control 
signal u(x) is chosen as 


u(k) = —Kx(k) 


where K is the state feedback gain matrix (a 1 X n matrix), then the system becomes 
a closed-loop control system as shown in Figure 6—1(b), and its state equation 
becomes 


x(k + 1) = (G — HK)x(k) (6-51) 


Note that we choose matrix K such that the eigenvalues of G — HK are the desired 
closed-loop poles, p, uo, . . . 5 Hn. 

We shall now prove that a necessary and sufficient condition for arbitrary pole 
placement is that the system be completely state controllable. We shall first derive 
the necessary condition. We begin by proving that, if the system is not completely 
state controllable, then there are eigenvalues of G — HK that cannot be controlled 
by state feedback. 
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Suppose the system of Equation (6—50) is not completely state controllable. 

Then the rank of the controllability matrix is less than n, or 
rank [H:GH:---:G"'H] 2 q <n (6-52) 


This means that there are q linearly independent column vectors in the controllability 
matrix. Let us define such q linearly independent column vectors as fj, f,,..., f}. 
Also, let us choose n — q additional n-vectors v4.1, V445, .. . , v, such that 


is of rank n. By using matrix P as the transformation matrix, let us define 
PUGP-G, P'H-É 
Then we have 


GP - PG 
Or 
[Gf, Gf, Gv i i Gya] = [fifi i f i Vaie i vÂ (6-53) 
Also, 
H = PH = [fiif i i f i va i v] (6-54) 


Since we have here q linearly independent column vectors f, fz, . . . , f4, we can use 
the Cayley-Hamilton theorem to express matrices Gf,, Gf), . . . , Gf, in terms of these 
q vectors. That is, 


Gf, = guf + gab +-+ Bai f, 
Gf, = gfi + gnf + -+> + gof, 


Gf, = gufi + guf + one + ga fy 


Hence, Equation (6-53) may be written as follows: 


8u 82 ''' 8u | figa Bigt2 7077 Ein 
8a $82 ^'^ 824 | 824i 8242 Ut S2n 
8n 8q2 Baq | Bagri Bagr Eqn 
= [f:...i fiy sey] | ----------------=-- p---------~------------------ 
[f f, Veni va] 0 0 0 | Bron dae Lorin 
0 0 0 | Enq+1 Qngqt2 Enn 
To simplify the notation, let us define 
8u 82 ''' Eu 
821 82 Us 824 = Gg 


Bad Ez `t Ey 
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Sigti 8igt2 7^5 Sin 
E2g+1 Ezg cc 82 | = Gn 
8qq+1 8qqt2 °°" Ban 
0 0 - 0 
Dod : | = Ga = (n — q) X q zero matrix 
0 0 0 
8q*1q41 8qtiqt2 ttt 8qtin 
8q+2q+1 8 q+2q+2 ttt Sqt2n — Gz 
Enq+i 8nq+2 ttt Enn 


Then Equation (6-53) can be written as follows: 


[Gf GR i Gypa +++: Gv] = [Bi i fyi vai val] S Ge] 
0 | Gy 
Thus, 
Gi | e 

G = | -+ 6-55 
| 0 | Gy ( ) 

Next, referring to Equation (6—54), we have 
H = [nibi iR ivaa iv] (6-56) 


Referring to Equation (6-52), notice that vector H can be written in terms of q 
linearly independent column vectors f;, b,..., f,. Thus, we have 


H- hif, t hy f, +. + haf, 


Consequently, Equation (6-56) may be written as follows: 


hy 
hifi + hab + ++ + hot, = [fiis f iver ies ivy] ha 
0 
0 
Thus, 
i= EJ (6-57) 
0 
where 
hy 
h 
Hi; = 2 
h 
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Now consider the closed-loop system equation given by Equation (6—51). The 
characteristic equation is 
|zI - G + HK| = 0 
Let us define 


and partition the matrix K to give 
K = [Ku : Ky] (6-58) 


where K, isa 1 x q matrix and Ky isa 1 X (n — q) matrix. Now, 1 X n matrix K 
can be written as follows: 


K = KP? = [K;: K;]P' 
Then the characteristic equation for the closed-loop system can be written as follows: 
|zI - G + HK| = [P '||zI - G + HK|IP| 
= |zI — P^!GP + P'HKP| 
= |zI- 6 + AK| 
Substituting Equations (6-55), (6-57), and (6-58) into this last equation, we obtain 


é Akl u0 ]_ [Gui Ge Hi : 
aè al = Lt] - [8949] pna 


= zI, = Gu + Hi K,,| zin- = Gz] (6-59) 


Equation (6-59) shows that matrix K = KP"! has control over the q eigenvalues of 
Gi - Hi K,;, but not over the n — q eigenvalues of G». That is, there are n — q 
eigenvalues of G — HK that do not depend on matrix K. Hence, we have proved 
that complete state controllability is a necessary condition for controlling all eigen- 
values (closed-loop pole locations) of matrix G — HK. 

We shall next derive a sufficient condition. We shall prove that if the system 
is completely state controllable then there exists a matrix K that will make the 
eigenvalues of G — HK as desired, or place the closed-loop poles at the desired 
locations. 

The desired eigenvalues of G — HK are p, 4, ... , tn; any complex eigenval- 
ues are to occur as conjugate pairs. Noting that the characteristic equation of the 
original system given by Equation (6—50) is 


lI-G|2z"-az"-az"?^-- + aniz + a, =0 
we define a transformation matrix T as follows: 
T=MW 
where 
M = [(H:GH:---:G"'! H] (6-60) 
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which is of rank n, and where 


an- dà» ccc a 1 
üí-2 3 cce 1 0 
Wza2|: ; F 
a 1 >. 0 0 
1 0 > 0 0 
Then, referring to Equations (6-35) and (6-36), we have 
0 1 0 e 0 
0 0 1 ©- 0 
T'GT-G-| : : f : 
0 0 0 1 
C, Tan- 4-2 7a 
and 
0 
A 0 
T'!'H-H-|: 
0 
1 
Next we define 
K=KT=[6, à. -- 8] 
Then 
0 0 0 0 
"m 0 0 0 0 
HK =/:|[6, S&a e !]-|: : 
0 0 > Q0 
1 6, 0, LN 0; 


The characteristic equation |zI — G + HK| becomes as follows: 


[z1 - G + HK| = |z1 - G + AR| 


10... 0 0 1 686 0 0 

0 1 -:: 0 0 0 e 0 0 0 
=|z[: : j-b io : Pei od 

0.0 0 0 0 68] 0 0 

0 0 .- 1 “år  —04.4 —4, Ô, Ôn -1 

z -1 0 

0 Z 0 

0 0 ei 

an + Ó, anita ++ zta té 


—z2't(at)"t-.--t(a.*8.)2*a,*8,-0 
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(6-61) 


(6-62) 


(6-63) 
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The characteristic equation with the desired eigenvalues is given by 
(z — pa)(z — n): (Z — m) 
= 2" + œz"! + amz5tectoe.zta =0 (6-64) 


Equating the coefficients of equal powers of z of Equations (6-63) and (6-64) we 
obtain 


a = a; + Ói 


a = a, + & 


a, =a, + 6, 


Hence, from Equation (6-62) we have 


K = ÅT! 
= [&, 6-1 °°" SJT 
= [an — ani On — an-ti a — aT (6-65) 


where the a;'s and the o;'s are known coefficients and T is a known matrix. Hence, 
we have determined the required feedback gain matrix K in terms of known coeffi- 
cients and a known matrix of the system. This proves the sufficient condition; that 
is, if the system defined by Equation (6-50) is completely state controllable, then 
it is always possible to determine the required state feedback gain matrix K for 
arbitrary pole placement. Hence, we have proved that a necessary and sufficient 
condition for arbitrary pole placement is that the system be completely state control- 
lable. 


Ackermann's Formula. The expression given by Equation (6—65) is not the 
only one used for the determination of the state feedback gain matrix K. There are 
other expressions available. In the following, we shall present one such expression, 
commonly called Ackermann's formula. 

Consider the system defined by Equation (6—50). It is assumed that the system 
is completely state controllable. By using the state feedback u(k) = —Kx(k), we 


wish to place closed-loop polesatz = 41,2 = M2,...,2Z = Mn. Thatis, we desire the 
characteristic equation to be 
[zI - G + HK] = (z — m)(z — Be) (Z — Hn) 
= 2" + az"! + az? +--+ + aaz + @ = 0 
Let us define 
G=G- HK 


Since the Cayley-Hamilton theorem states that G satisfies its own characteristic 
equation, we have 


G" + a Č"! + a G"? + +++ + aG + a,1 = o(G) =0 


We shall utilize this last equation to derive Ackermann's formula. 
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Consider now the following identities: 
I-I 
G-G-HK 
G = (G - HK = G'- GHK - HKG 
G = (G - HK)’ = G - GHK - GHKG — HKG^ 


G" = (G - HK)" = G" - G! HK - -..  HKG'^ 


Multiplying the preceding equations in order by a,, o, ,. .. , as (where a = 1), 
respectively, and adding the results, we obtain 


anI + anG + Oyo G@ + +++ + 6" = 1 + OG + a, ,G 
+ +++ + G” — an1 HK — a,-7GHK - aœ- HKG - --- GC HK - --- 
- HKG"! 


which can be written as follows: 


$(G) = $(G) - a. HK - a,-.GHK — an- HKG - --- — HKG"! — G"! HK 
On -1 K+ Qn-2 KG Tex KG"! 
e "T Fn-2 
= $(G) - [H:GH:---:G"'H] an-2 K + 0,5 KG +--+ KG ie 
K 


Notice that 
$(G) = 0 
Hence, Equation (6-66) may be modified to read 
a@,-1K + a,-2 KG Ae gop Se KG"! 
(G) = [H:GH:---:G""' H] an-2K + a, KG +- + KES? T 
K 


Since the system is completely state controllable, the controllability matrix 


is of rank n and its inverse exists. Then Equation (6-67) can be modified to the form 


OQ, .1 K + a,2KG ++ KG" 
æn K + Qn-3 KG +--+ + KG"? 


K 
Premultiplying both sides of this last equation by [0 0 --- 0 1], we obtain 
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an-ı K + æn- KG C sate KG! 


[D 0 + 0 1] 2E * a, KG te + KG"? 
K 
-[0 O --- 0 I1J[R:GH:---:G"' H] ! $6(G) 
which can be simplified to 
K-[0 0 --- 0 I1J[:GH:---:G" ' H] ! $(G) (6—68) 


Equation (6—68) gives the required state feedback gain matrix K. It is this particular 
expression for matrix K that is commonly called Ackermann's formula. [See Prob- 
lem A-6-12 for the derivation of Equation (6-68) when n = 3.] 


Comments. The state feedback gain matrix K is determined in such a way that 
the error (caused by disturbances) will reduce to zero with sufficient speed. Note that 
the matrix K is not unique for a given system, but depends on the desired closed- 
loop pole locations (which determine the speed of response) selected. The selection 
of the desired closed-loop poles or the desired characteristic equation is a com- 
promise between the rapidity of the response of the error vector and the sensitivity 
to disturbances and measurement noises. That is, if we increase the speed of error 
response, then the adverse effects of disturbances and measurement noises gen- 
erally increase. In determining the state feedback gain matrix K for a given system, 
it is desirable to examine several matrices K based on several different desired 
characteristic equations and to choose the one that gives the best overall system 
performance. 

Once the desired characteristic equation is selected, there are several different 
ways to determine the corresponding state feedback gain matrix K for the system 
defined by Equation (6-50) which is assumed to be completely state controllable. 
Four of them are listed in the following. 


1. As shown in the preceding discussion, matrix K can be given by Equa- 
tion (6-65): 
K = [æn — an| @n-1 — 4,42: — ai]T! 
= [æn — An! @n-1 — an-11 ttt a, — a (MW) (6-69) 
where the a;'s are the coefficients of the original system characteristic equation 
|zI — G| = z" + az"! +-+ az +4, =0 


and the a;'s are the coefficients of the desired characteristic equation for the 
state feedback control system; that is, 


EI-G-HK|-z"'taz"---touztoa-0 
Matrix T is given by 
T-MW (6—70) 
where M and W are given by Equations (6—60) and (6—61), respectively. 
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If the system state equation is already in the controllable canonical form, 
the determination of the state feedback gain matrix K can be made simple, 
because the transformation matrix T becomes the identity matrix. In this case 
the desired matrix K is obtained by substituting T - MW - I into Equation 
(6—69). 


- The desired state feedback gain matrix K can be given by Ackermann's 
formula: 


K-[0 0 :-- 0 1)[H:GH:---:G"’H]'¢(G) (6-71) 
where 
&(G) = G” + aG! t+ e+) + aG + al 
. If the desired eigenvalues ju, W2, . . . , Mn are distinct, then the desired state 
feedback gain matrix K can be given as follows: 
K-[ 1 +e 1f[£:&i--:&]" (6-72) 
where vectors £;,&, .. . , £, satisfy the equation 


& = (G — mD ! H, i=1,2,...,n 


Note that the £;'s are eigenvectors of matrix G — HK; that is, &; satisfies the 
equation 


(G- HK) = më, i=1,2,...,n 


For the deadbeat response, p, = {m = +++ = p, = 0. Equation (6-72) 
for this case can be simplified as follows: 
K-[1 0 -- OJff:&:-:&]" (6-73) 
where 
& -G'H, &-G^H, .., &£&-G"H 


[For detailed derivations of Equations (6—72) and (6—73), see Problems 
A-6-12 and A~6-13.] 


characteristic equation 


lzI- G + HK| = 0 


and then match the coefficients of powers in z of this characteristic equation 
with equal powers in z of the desired characteristic equation 


z+ azl +. +a, 1z7 +a, =0 


Such a direct calculation of matrix K may be simpler for low-order systems. 


Example 6-6 


Consider the system 


x(k + 1) = Gx(k) + Hu(k) 
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where 
E 0 1 _ 10 
JEF E n=] 
Note that 
mz -1 |_ 2 
iz 1- G| = 016 E z? +z +0.16 
Hence, 


a, = 1, à; = 0.16 


Determine a suitable state feedback gain matrix K such that the system will have the 
closed-loop poles at 


z =0.5 + j0.5, z-05-j0.5 


Let us first examine the rank of the controllability matrix. The rank of 
; .|[0 1 
[H: GH] = E 2 


is 2. Thus, the system is completely state controllable, and therefore arbitrary pole 
placement is possible. The characteristic equation for the desired system is 


lz1- G + HK| = (z - 0.5 — j0.5)(z — 0.5 + j0.5) = zZ-z € 0.520 
Hence, 
a=-1, a=0.5 
We shall demonstrate four different ways to determine matrix K. 
Method1. From Equation (6—69), the state feedback gain matrix K is given as follows: 
K = [æ — a$ œ — ai]T^ 


Notice that the original system is already in a controllable canonical form, and therefore 
the transformation matrix T becomes I: 


aba th fo afa alfa o 
T = mw = [Hi cH] 4 E E ele ] 


K = [œ — aria — ài] = [0.5 — 0.16: -1 — 1] 
= [0.34 -2] 


Hence, 


Method 2. Referring to Ackermann’s formula given by Equation (6-71), we have 
K = (0 1]H:GH] (G) 


where 


bon. _f-o16 -1 ]_[ o 1], [os o 
EVES c+ost=| 0.16 m ee HEF 0.5 


[034 -2 
02 24 
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Thus, 
B o 1l fo.34 -2 
sp ul E [e 4] 
= [0.34 -2] 


Method 3. From Equation (6-72), the desired state feedback gain matrix K is deter- 
mined as follows: 


K=[1 1f& &]' 
where 
& = (G - mD H, i-12 
Since u = 0.5 + j0.5, we have 
& = [G — (0.5  j0.5I| ' H 


-1 
_ | -0.5 - 0.5 1 “Tol _ 999) 
2 —0.16 —1.5 - j0.5 1 —0.5 — j0.5 
0.66 +j 
Similarly, for u; = 0.5 — j0.5, we have 
& = [G - (0.5 — j0.51]] ' H 
A a 
_ | -0.5 + j0.5 1 EE 
—0.16 -1.5 + j0.5 1 —0.5 + j0.5 
0.66 — j 
Consequently, we have 
-1 -1 -1 
0.66 + j 0.66 -j 
*-- il 
[& & =| os- j0.5 —0.5 + j0.5 
0.66 + j 0.66 — j 
0.7178(1 — j) — 1.4356 


1-4 j0.66 1+ j0.66 
-0.7178(1 +j) — 1.4356 
-1+ 0.66  -1-j0.66 


Hence, the desired state feedback gain matrix K is determined to be 
K-[ 1)[& &]' 
0.7178(1— j) — —1.4356 
1 + j0.66 1 + j0.66 


~0.7178(1 + j) 1.4356 
-1-j0.66 —1 + j0.66 
= [0.34 -2] 


=H i 
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Method 4. It is noted that for lower-order systems such as this one it may be simpler 
to substitute 
K = [ki kz] 


into the characteristic equation and to write the equation in terms of undetermined k’s. 
Then this characteristic equation is equated with the desired characteristic equation. 


The procedure is as follows: 
z 0 0 1 0 
E J 2 ET a Hz ka 


-| z -1 
0.16 + ki z+1lt+k 


z? + (1+ kaz + 0.16+k, =0 


|zI — G + HK| = 


Now we equate this characteristic equation with the desired characteristic equation 
(z — 0.5 — j0.5)(z — 0.5 + j0.5) = 0 
so that 
z? + (1+ kaz + 0.16 + kı = zZ—z * 0.5 

By comparing the coefficients of equal powers of z, we obtain 

1+kk = -1, 0.16 + ki = 0.5 
from which we get 

kı = 0.34, k2 = -2 
Thus, the desired state feedback gain matrix K is given by 
K={[k, k] = [0.34 -2] 


It is noted that for higher-order systems the calculations involved by this approach may 
become laborious. For such a case, other methods may be preferred. 


Deadbeat Response. Consider the system defined by 
x(k + 1) = Gx(k) + Hu(k) 


With state feedback u(k) = —Kx(k), the state equation becomes 


x(k + 1) = (G — HK)x(k) 


Note that the solution of this last equation is given by 


x(k) = (G — HK)'x(0) (6-74) 


If the eigenvalues w; of matrix G — HK lie inside the unit circle, then the system is 
asymptotically stable. 


In what follows, we shall show that, by choosing all eigenvalues of G — HK to 


be zero, it is possible to get the deadbeat response, or 


x(k) = 0, fork =q,q=n 


In discussing deadbeat response, the nilpotent matrix 


* 
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010 0 
0.0 1 -- 0 
N-2|: : : : 
000 =. 1 
000 .- 0 
plays an important role. Consider, for example, a 4 x 4 nilpotent matrix: 
01 0 0 
1001 0 
N-lo00 1 
000 0 
Notice that 
001 0 000 1 0000 
0 00 1 0000 0000 
2 — 3. 4 
N-ioooo^ N-7loooop N=lo 00 0 
00 0 0 00 0 0 0000 
Similarly, for an n X n nilpotent matrix N, we have 
N'-09 
Now consider the completely state controllable system given by 
x(k + 1) = Gx(k) + Hu(k) (6-75) 
Let us choose the desired pole locations to be at the origin, or choose the desired 
eigenvalues to be zero: w = m = --- = un = 0. Then we shall show that the re- 


sponse to any initial state x(0) is deadbeat. Since the characteristic equation with the 
desired eigenvalues can be given by 


(z — m)(z — pa) (2 — Hn) = z" + az! +--+ t+ aaz +a, = 2" 
we obtain 
== SAFO 
and matrix K given by Equation (6-65) can be simplified to the following: 
K-[o,—2a,:9,4 — Gi: io aT 
—-[-a4, ~an- +++ -aT (6—76) 
By using the transformation matrix T given by Equation (6—32), define 
x(k) = Tx(k) 
Define also 
T'GT-G, T'H=ff 
Then Equation (6-75) can be written as 
R(k + 1) = T! GT&(k) + T Hu(k) = G&(k) + Hu(k) 
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If we use the state feedback u(k) = —Kx(k) = —KT&(K), then this last equation 
becomes 

&(k + 1) = (G — HKT)i(k) 
Referring to Equation (6-76), we have 


G-ÓÜKTS6-Hüea Hay SS a) 
0 1 0 e 0 0 
0 0 1 es 0 0 
=j : : : © jo ilia ~an- -a] 

0 0 0 1 0 

Tan An-1  —Un-2 —0 1 

0 1 0 0 0 0 0 0 
0 0 1 0 0 0 0 0 
0 0 0 1 0 0 0 0 
CO. ân- | 7-2 coc 00 Tân cpi ~Gn-2 cc TA 
0 1 0 0 

001 0 

000-1 

000 0 


Thus, G — ÉIKT is a nilpotent matrix. Therefore, we have 
(G - HKT)" = 0 
In terms of the original state x(k), we have 
x(n) = (G — HKy'x(0) = (TGT^' — THK)"x(0) = [T(G — ÉKT)T^'] x(0) 
= T(G — ÉKTY T-!x(0) = 0 


Thus, we have shown that if the desired eigenvalues are all zeros then any initial state 
x(0) can be brought to the origin in at most n sampling periods and the response is 
deadbeat, provided the control signal u(k) is unbounded. 


Comments on Deadbeat Control. The concept of deadbeat response is unique 
to discrete-time control systems. There is no such thing as deadbeat response in 
continuous-time control systems. In deadbeat control, any nonzero error vector will 
be driven to zero in at most n sampling periods if the magnitude of the scalar control 
u(k) is unbounded. The settling time depends on the sampling period, since the 
response settles down in at most n sampling periods. If the sampling period T is 
chosen very small, the settling time will also be very small, which implies that the 
control signal must have an extremely large magnitude. Otherwise, it will not be 
possible to bring the error response to zero in a short time period. 

In deadbeat control, the sampling period is the only design parameter. Thus, 
if the deadbeat response is desired, the designer must choose the sampling period 
carefully so that an extremely large control magnitude is not required in normal 
operation of the system. Note that it is not physically possible to increase the 
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magnitude of the control signal without bound. If the magnitude is increased suffi- 
ciently, the saturation phenomenon always takes place. If saturation occurs in the 
magnitude of the control signal, then the response can no longer be deadbeat. The 
settling time will be more than n sampling periods. In the actual design of deadbeat 
control systems, the designer must be aware of the trade-off that must be made 
between the magnitude of the control signal and the response speed. 


Example 6-7 
Consider the system given by 
[ates B=] 01, ipe. [e en 
Determine the state feedback gain matrix K such that when the control signal is 
given by 
u(k) = —Kx(k) 


the closed-loop system (regulator system) exhibits the deadbeat response to an initial 
state x(0). Assume that the control signal u(k) is unbounded. 
Referring to Equation (6-76), for the deadbeat response we have 


K-[-« -a]T^ (6-78) 


The system given by Equation (6-77) is already in the controllable canonical form. 
Therefore, in Equation (6-78), T = I. The characteristic equation for the system given 
by Equation (6-77) is 


z 


7 - 
I -Gl-]oie z+ i 


=z? +z +0.16=z?+az +a 


Thus, 
ài — 1, à; = 0.16 
Consequently, Equation (6-78) becomes 
K =[-a, -a]^[-0.16 -1] 


This gives the desired state feedback gain matrix. 
Let us verify that the response of this system to an arbitrary initial state x(0) is 
indeed the deadbeat response. Since the closed-loop state equation becomes 


i(k + 1) - 0 1 i(k) 0 i(k) 
eae A9] [os 1] 209 | 
E 
"(10 0| x(k) 
if the initial state is given by 
:al-l 
x2(0) b 
where a and b are arbitrary constants, then we have 
aje sl fs) 
xX1| |0 O|x(0| |0O olb] lo 
eal- d]- t -h 
x2] Jo O|x()| |o o|o| Jo 


418 Pole Placement and Observer Design Chap. 6 


Thus, the state x(k) for k = 2,3,4,... becomes zero and the response is indeed 
deadbeat. 


Pole Placement When the Control Signal Is a Vector. Thus far, we have 
considered the pole placement design problem when the control signal is a scalar. 
If the control signal is a vector quantity (r-vector), the response can be speeded up, 
because we have more freedom to choose control signals u,(k), uk), . . . , u,(k) to 
speed up the response. For example, in the case of the nth-order system with a scalar 
control, the deadbeat response can be achieved in at most n sampling periods. In 
the case of the vector control u(k), the deadbeat response can be achieved in less 
than n sampling periods. 

In the case of the vector control, however, the determination of the state 
feedback gain matrix K becomes more complex. We shall present such a case in 
Appendix C. 


Control System With Reference Input. Thus far, we have considered regulator 
systems. In the regulator system, the reference input is fixed for a long period, and 
external disturbances create nonzero states. The characteristic equation for the 
system determines the speed by which the nonzero states approach the origin. In 
what follows, we shall consider the case where the system has a reference input. 

Consider the system shown in Figure 6-2. The plant is described by the 
following state and output equations: 


x(k + 1) = Gx(k) + Hu(k) 

y(k) = Cx(k) 

The control signal u(x) is given by 
u(k) = Kor(k) — Kx(k) 
By eliminating u(k) from the state equation, we have 
x(k + 1) = (G — HK)x(k) + HKor(k) 

The characteristic equation for the system is 

|zI - G + HK| = 0 


As stated earlier, if the system is completely state controllable, then the feedback 
gain matrix K can be determined to yield the desired closed-loop poles. 


Figure 6-2 State feedback control system. 
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It is important to point out that state feedback can change the characteristic 
equation for the system, but in doing so the steady-state gain of the entire system 
is changed. Therefore, it is necessary to have an adjustable gain K, in the system. 
This gain Ky should be adjusted such that the unit-step response of the system at 
steady state is unity, or y(~) = 1. To clarify the details, consider the following 
example problem. 

Example 6-8 
Consider the system defined by 


x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) 
u(k) = Kor(k) — Kx(k) 


0 1 0 
E? ES n=?) esM 


Design a control system such that the desired closed-loop poles of the characteristic 
equation are at 


where 


zı = 0.5 + j0.5, z2 = 0.5 — j0.5 
Thus, the desired characteristic polynomial is given by 
lzI - G + HK| = (z — 0.5 — j0.5)(z — 0.5 + 0.5) 
-z72-—z40.5 
The state feedback gain matrix K can be determined as 
K = [0.34 —2] 


(See Example 6-6 for the computation for determining matrix K.) 
Using this K matrix, the state equation becomes 


x(k + 1) = (G — HK)x(k) + HKor(k) 
= Gx(k) + Hr(k) 
where 
G-G-HK, H=HK, 


The gain constant Ko can be determined in state space or can be determined in the z 
plane using the pulse transfer function. In this example, we shall use the latter approach. 
The pulse transfer function Y(z)/R(z) for this system is given by 


G(z) = C(zl - G6)" Ê 


: o — 1] [o 0 1 
E dE ET J = Ho ac ET 1 


ije- [s 


where 


ü 
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Hence, 
-1 
E Zz -1 0 
Cele ll al g 5 z- À B 
= Ko 
z?-z-0.5 
Thus, 
Y(z) Nu Ko 
Rey 919) gs 


To determine gain constant Ko, we use the condition that the steady-state output y(») 
for the unit-step input is unity, or 


lim y(k) = lim(1 — z )Y(z) 
kom z—1 


P" 
z1 zZz z-ztü05z-1 
=2Ko=1 
Hence, we have determined Ko as 
Ko = 0.5 


Figure 6—3 shows block diagrams of the designed system. The unit-step response of 
this system can be obtained easily by use of MATLAB. MATLAB Program 6-1 is a 
sample program for obtaining the unit-step response. Figure 6—4 shows the resulting 
response curve. 


(b) 


Figure 6-3 (a) Block diagram of the control system designed in Example 6-8; 
(b) simplified block diagram. 


Sec. 6-6 State Observers 421 


MATLAB Program 6-1 


num -[0 0. 0.5] 
dens[t -1.. 0.5]; 

t = ones(1,41): 

ve[0 40 0 1.6] 
axis(v); 

k= 0:40; 

y.» filter(num,;den, r3; 
plot(k y,'o*) 

grid 

title(‘Unit-Step Response!) 
xlabel('k') 
ylabel(‘y(k)) 


Unit-Step Response 


1 [Uus tttm Meet 
DV : i : : 
z : : : 
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JE 
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ode i LE io i a a O | 


Figure 6-4 Unit-step response of the system shown in Figure 6-3(b). 


6-6 STATE OBSERVERS 


In Section 6-5 we discussed a pole placement design method that utilizes the 
feedback of all state variables to form the desired control vector. In practice, 
however, not all state variables are available for direct measurement. In many 
practical cases, only a few state variables of a given system are measurable, and the 
rest are not measurable. For instance, it may be that only the output variables are 
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Figure 6-5 Schematic diagram of the 
state observer. 


measurable. Hence, it is necessary to estimate the state variables that are not directly 
measurable. Such estimation is commonly called observation. In a practical system 
it is necessary to observe or estimate the unmeasurable state variables from the 
output and control variables. 

A state observer , also called a state estimator, is a subsystem in the control 
system that performs an estimation of the state variables based on the measurements 
of the output and control variables. Here, the concept of observability discussed in 
Section 6-3 plays an important role. As we shall see later, state observers can be 
designed if and only if the observability condition is satisfied. 

In the following discussions of state observers, we shall use the notation x(k) 
to designate the observed state. vector. In many cases the observed state vector 
x(k) is used in the state feedback to generate the optimal control vector. Figure 6—5 
shows a schematic diagram of a state observer. The state observer will have y(k) and 
u(k) as inputs and x(k) as output. 

In what follows, we shall first discuss the necessary and sufficient condition for 
state observation and then treat the full-order state observer. Full-order state obser- 
vation means that we observe (estimate) all n state variables regardless of whether 
some state variables are available for direct measurement. There are times when this 
will be unnecessary, when we will need observation of only the unmeasurable state 
variables but not of those that are directly measurable. Observation of only the 
unmeasurable state variables is referred to as minimum-order state observation, and 
we shall discuss it later in this section. Observation of all unmeasurable state 
variables plus some (but not all) of the measurable state variables is referred to as 
reduced-order state observation. 


Necessary and Sufficient Condition for State Observation. Figure 6-6 shows a 
regulator system with a state observer. We shall discuss a necessary and sufficient 
condition under which the state vector can be observed (estimated). From Figure 6-6 
we obtain the state and output equations as follows: 


x(k + 1) = Gx(k) + Hu(k) (6-79) 


y(k) = Cx(k) (6-80) 
where 
x(k) = state vector (n-vector) 


u(k) = control vector (r-vector) 

y(k) = output vector (m-vector) 
G =n X n nonsingular matrix 
H = n x r matrix 


C= m X n matrix 
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State 
observer 


Figure 6-6 Regulator system with a state observer. 


To be able to observe (estimate) state variables, we must be able to obtain x(k + 1) 
in terms of y(k), y(k — 1),..., y(k — n + 1) andu(k),u(k — 1),...,u(k — n + 1). 
From Equation (6-79), we have 


G'x(k + 1) = x(k) + G Hu(K) 
or 
x(k) = G' x(k + 1) - G` Hu(k) (6-81) 
By shifting k by 1, we get 
x(k — 1) = G'x(k) - G` Hu(k — 1) (6-82) 
By substituting Equation (6-81) into Equation (6-82), we obtain 
x(k — 1) = G'[G x(k + 1) - G' Hu(k)] - G' Hu(k - 1) 
= G?x(k + 1) - G?Hu(k) - G Hu(k — 1) 
Similarly, 
x(k — 2) = G?x(k) — G?Hu(k — 1) - G Hu(k - 2) 
= G?x(k + 1) - G^Hu(k) - G?Hu(k — 1) - G’ Hu(k ~ 2) 


x(k —n + 1) = G"x(k + 1) - G"Hu(k) - G"*' Hu(k - 1) 
—.—G'Hu(k - n + 1) 
By substituting Equation (6-81) into Equation (6—80), we obtain 
y(k) = Cx(k) = CG ^! x(k + 1) - CG ^! Hu(K) 
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Similarly, 
y(k — 1) = Cx(k — 1) = CG’ x(k + 1) - CG? Hu(k) — CG^' Hu(k - 1) 
y(k — 2) = €x(k - 2) = CGx(k + 1) - CG? Hu(k) — CG Hu(k — 1) 
~ CG^! Hu(k — 2) 


yk -n + 1) = Cx(k ~ n + 1) = CG™x(k + 1) - CG"Hu(K) 


-CG""Hu(k - 1) - --- — CG" Hu(k - n + 1) 
By combining the preceding n equations into one matrix equation, we get 
y(k) CG" 
XE Dus CG redi 
yk-n*1] leon 
CG'H 0 ZE 0 u(k) 
" CG^H CG"H ZE 9 u(k m2 
CG^H CG^""H + CG^H]|u(k — n + 1) 
or 
cc" y(k) 
C6 + y=] WEED 
CG^ y(k — n +1) 
CG'H 0 ree 0 u(k) 
,ICG?^H CG'H > 0 u(k ~ 1) 
CG"H CG^"'"H ... CGH u(k — n +1) 
(6-83) 


Notice that the right-hand side of Equation (6-83) is entirely known. Hence, 
x(k + 1) can be determined if and only if 


rank! ~. =n (6-84) 
CG” 
Since matrix G is nonsingular, multiplication of each row of the left-hand side of 
Equation (6-84) by G” does not change the rank condition. Hence, Equation (6-84) 
is equivalent to 
CG"! 


n-2 
rank <e =n 


c 
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which is also equivalent to 
rank [C* : G*C* :--: (G9)! C*$] = n (6-85) 


Clearly, this is the complete observability condition of the system defined by Equa- 
tions (6-79) and (6—80). [Refer to Equation (6—17).] This means that if Equation 
(6—85) is satisfied (that is, if the system is completely observable) then x(k + 1) can 
be determined from y(k), y(k — 1),...,y(k —n +1) and u(k),u(k — 1),..., 
u(k — n + 1). Thus, we have shown that the necessary and sufficient condition for 
state observation is that the system be completely observable. 

As a special case, if y(k) is a scalar and matrix C is a 1 x n matrix, then 
x(k + 1) can be obtained by premultiplying both sides of Equation (6—83) by the 
inverse of the matrix given in Equation (6—84), as follows: 


CG" - y(k) 
x(k + 1)= |S e c) 
CG” y(k—-n +1) 
CG^[|'[cc^'H 0 e 0 u(k) 
,|CG?^| |CG?H cG"H > oœ u(k — 1) 
CG"| |CG"H CG^"H --. CG^H]lu(k — n +1) 


(6-86) 


Equation (6-86) gives x(k + 1) when y(k) is a scalar. 

As shown in the foregoing analysis, the state x(k + 1) can be determined from 
Equation (6-83) provided the system is completely observable. Thus, for a com- 
pletely observable system, the state vector can be determined in at most n sampling 
periods. In the presence of external disturbances and measurement noises, however, 
this approach may not give an accurate determination of the state vector. Hence, 
to determine the state vector in the presence of disturbances and measurement 
noises, a different approach is necessary. Also, if matrix C is nota 1 X n matrix but 
isanm Xx n matrix (m > 1), then the inverse of the matrix of Equation (6-84) cannot 
be defined and Equation (6-86) does not apply. To cope with such cases, one very 
powerful approach for estimating the state vector is to use a dynamic model of the 
original system, as follows. 

Consider the control system defined by Equations (6-79) and (6-80). Let us 
assume that the state x(k) is to be approximated by the state x(k) of the dynamic 
model: 


&(k + 1) = G&(k) + Hu(k) (6-87) 
$(k) = C&(K) (6-88) 


where matrices G, H, and C are the same as those of the original system. Also, let 
us assume that the dynamic model is subjected to the same control signal u(k) as 
the original system. If the initial conditions for the actual system defined by Equa- 
tions (6-79) and (6-80) and the dynamic model defined by Equations (6-87) and 
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(6-88) are the same, then the state x(k) and the state x(k) will be the same. If the 
initial conditions are different, then the state x(k) and the state x(k) will be different. 

If the matrix G is a stable one, however, x(k) will approach x(k) even for 
different initial conditions, as we shall see. If we denote the difference between x(k) 
and x(k) as e(K), or define 


e(k) = x(k) — x(k) 
then by subtracting Equation (6-87) from Equation (6-79), we obtain 
x(k + 1) — x(k + 1) = G[x(k) — x(k)] 
or 
e(k + 1) = Ge(k) 


If matrix G is a stable matrix, then e(&) will approach zero and x(k) will approach 
x(k). However, the behavior of the error vector, which depends solely on matrix G, 
may not be acceptable. Also, if matrix G is not a stable matrix, then the error e(k) 
will not approach zero. It is therefore desirable to modify the dynamic model defined 
by Equations (6-87) and (6—88). 

It is noted that although the state x(k) may not be measurable the output y(k) 
is measurable. The dynamic model defined by Equations (6-87) and (6-88) does 
not make use of the measured output y(k). The performance of the dynamic model 
can be improved if the difference between the measured output y(k) and the 
estimated output Cx(K) is used to monitor the state x(x), that is, if the dynamic model 
of Equation (6—87) is modified into the following form: 


&(k + 1) = G&(k) + Hu(k) + K.[y(k) — C&(K)] 


where matrix K, serves as a weighting matrix. (This means that the dynamics of the 
state observer shown in Figure 6-6 must be given by this last equation.) In the 
presence of discrepancies between the G and H matrices used in the model and those 
of the actual system, the addition of the difference between the measured output and 
the estimated output will help reduce the differences between the dynamic model 
and the actual system. 

In what follows we shall discuss details of the observer whose dynamics are 
characterized by G and H matrices and by the additional correction term, which 
consists of the difference between the measured output and the estimated output. 


Full-Order State Observer. The order of the state observer that will be dis- 
cussed here is the same as that of the system. As stated earlier, such a state observer 
is called a full-order state observer. 

In the following analysis we assume that the actual state x(k) cannot be 
measured directly. If the state x(k) is to be estimated, it is desirable that the observed 
state or estimated state x(k) be as close to the actual state x(k) as possible. Although 
it is not necessary, it is convenient if the state observer has the same G and H matrices 
as the original system. 

It is important to note that, in the present analysis, state x(k) is not available 
for direct measurement, and consequently the observed state x(k) cannot be com- 


y" 
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Figure 6-7 State feedback control system. 


pared with the actual state x(k). Since the output y(k) = Cx(k) can be measured, 
however, it is possible to compare y(k) = Cx(k) with y(K). 

Consider the state feedback control system shown in Figure 6-7. The system 
equations are 


x(k + 1) = Gx(k) + Hu(k) (6-89) 
y(k) = Cx(k) (6-90) 
u(k) = -Kx(K) 


where 

x(k) = state vector (n-vector) 

u(k) = control vector (r-vector) 

y(k) = output vector (m-vector) 
G =n X n nonsingular matrix 
H =n X r matrix 
C= m X n matrix 
K - state feedback gain matrix (n X r matrix) 


We assume that the system is completely state controllable and completely observ- 
able, but x(k) is not available for direct measurement. Figure 6-8 shows a state 
observer incorporated into the system of Figure 6-7. The observed state x(k) is used 
to form the control vector u(k), or 


u(k) = ~Kx(k) (6-91) 
From Figure 6-8, we have 
X(k + 1) = Gx(k) + Hu(k) + K.[y(k) — $()] (6-92) 


where K, is the observer feedback gain matrix (an n X m matrix). This last equation 
can be modified to read 


i(k + 1) = (G — K. C)x(k) + Hu(k) + K, y(k) (6-93) 
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yik} 


Figure 6-8 Observed-state feedback control system. 


The state observer given by Equation (6-93) is called a prediction observer, since 
the estimate x(k + 1) is one sampling period ahead of the measurement y(k). The 
eigenvalues of G — K, C are commonly called the observer poles. 


Error Dynamics of the Full-Order State Observer. Notice that if x(k) = x(k), 
then Equation (6-93) becomes 


x(k + 1) = Gx(k) + Hu(k) 
which is identical to the state equation of the system. Thus, if &(k) = x(k), then the 
response of the state observer system is identical to the response of the original 
system. 
To obtain the observer error equation, let us subtract Equation (6-93) from 
Equation (6-89): 
x(k + 1) — x(k + 1) = (G — K. OJ[x(&) — x(k)] (6-94) 
Now let us define the difference between x(k) and x(k) as the error e(k): 
e(k) = x(k) — x(k) 
Then Equation (6-94) becomes 
e(k + 1) = (G - K, C)e(k) (6-95) 


From Equation (6-95) we see that the dynamic behavior of the error signal is 
determined by the eigenvalues of G — K, C. If matrix G — K, C is a stable matrix, 
the error vector will converge to zero for any initial error e(0). That is, x(k) will 
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converge to x(k) regardless of the values of x(0) and x(0). If the eigenvalues of 
G — K.C are located in such a way that the dynamic behavior of the error vector 
is adequately fast, then any error will tend to zero with adequate speed. One way 
to obtain fast response is to use deadbeat response. This can be achieved if all 
eigenvalues of G — K, C are chosen to be zero. 


Comments. Since the system defined by Equations (6-89) and (6-90) is 
assumed to be completely observable, an arbitrary placement of the eigenvalues of 
G — K, Cis possible. To explain this further, notice that the eigenvalues of G — K, C 
and those of G* — C*K7 are the same. By use of the principle of duality presented 
in Section 63, the condition for complete observability for the system defined by 
Equations (6-89) and (6-90) is the same as the complete state controllability 
condition for the system 


x(k + 1) = G*x(k) + C*u(k) (6-96) 


In Section 6—5 we saw that arbitrary pole placement is possible for the system of 
Equation (6-96) provided it is completely state controllable or provided the rank of 
the matrix 


is n. [This is the condition for complete observability of the system defined by 
Equations (6-89) and (6—90).] For the system defined by Equation (6-96), by 
selecting a set of n desired eigenvalues of G* — C*K, the state feedback gain matrix 
K may be determined. The desired matrix; K,, such that the eigenvalues of G — K, C 
are the same as those of G* — C*K, is related to matrix K by the equation K, = K*. 


Example 6-9 
Consider the system 
x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) 


0 —0.16 0 
s-[! e | a- [t] C-[O0 1] 


Design a full-order state observer, assuming that the system configuration is identical 
to that shown in Figure 6—8. The desired eigenvalues of the observer matrix are 


z=0.5 + j0.5, z = 0.5 — j0.5 
and so the desired characteristic equation is 
(z — 0.5 — j0.5)(z - 0.5 + j0.5) = z*7-z+05=0 


Since the configuration of the state observer is specified as shown in Figure 6-8, 
the design of the state observer reduces to the determination of an appropriate observer 
feedback gain matrix K.. Before we proceed further, let us examine the observability 
matrix. The rank of 


where 


meco 1 
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is 2. Hence, the system is completely observable and determination of the desired 
observer feedback gain matrix is possible. 
Referring to Equation (6—95) 


e(k + 1) = (G — K. C)e(k) 
where 
e(k) = x(k) — x(k) 
the characteristic equation of the observer becomes 
ZI -G+K.C| - 0 


Let us denote the observer feedback gain matrix K. as follows: 


Then the characteristic equation becomes 


ETETE a 


which reduces to 


z 0.16 + kı 


-1 z+1+k| 7? 


z? + (1+ k)z + kı +0.16 = 0 (6-97) 
Since the desired characteristic equation is 
z-zt-05-0 
by comparing Equation (6-97) with this last equation, we obtain 
kı = 0.34, k, = -2 


or 


Note that the dual relationship exists between the system state equation considered in 
Example 6-6 and that of the present system. The state feedback gain matrix K obtained 
in Example 6-6 was K = [0.34 —2]. The observer feedback gain matrix K. obtained 
here is related to matrix K by the relationship K, — K*. 


Design of Prediction Observers. We have thus far discussed full-order predic- 


tion observers. They are prediction observers because the estimate x(k + 1) is one 
sampling period ahead of the measurement y(k). We solved a simple example 
problem by assuming the matrix K, to exist and determined the characteristic 
equation [zI — G + K, C| = 0 to have prescribed eigenvalues. In what follows we 
shall discuss a more general approach to determine the observer feedback gain 
matrix K,. 


Consider the system defined by 
x(k + 1) = Gx(k) + Hu(k) (6-98) 
y(k) = Cx(k) (6-99) 
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where 
x(k) = state vector (n-vector) 
u(k) = control vector (r-vector) 
y(k) = output signal (scalar) 
G =n X n nonsingular matrix 
H = n x r matrix 
C = 1 X n matrix 


The system is assumed to be completely state controllable and completely observ- 
able. Thus, the inverse of 


exists. We also assume that the control law to be used is 
u(k) = —K(k) 
where x(k) is the observed state and K is an r X n matrix. Assume further that the 


system configuration is the same as that shown in Figure 6-8. 
The state observer dynamics are given by the equation 


x(k + 1) = Gx(k) + Hu(k) + K.[y(k) — y(k)] 


= (G — K,C)x(k) + Hu(k) + K, Cx(k) (6-100) 
First, define 
Q = (WN*)'! (6-101) 
where 
N = [C*: G#C*:--- : (G*)"'C*] (6-102) 
and 
An-1  An-2 a 1 
4-2. 4-3 1 0 
We=!: : E (6-103) 
[^7] 1 0 0 
1 0 0 0 
where 4,45, ...,0,-, are coefficients in the characteristic equation of the original 


state equation given by Equation (6-98), 
lI-G|-z"-az"t4-:-:taazcta-0 
Next, define 
x(k) = Q&(k) (6-104) 


where £(K) is an n-vector. By use of Equation (6-104), Equations (6-98) and (6-99) 
can be modified to read 
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E(k + 1) = Q'GQO&(K) + Q~ Hu(&) (6-105) 
y(k) = CQE(K) (6-106) 
where 
0 0 +++ 0 ca, 
Q'eQ-|] 9 77 9 79e (6-107) 
0 0 1 -a 
CQ-[0 O --. O 1] (6-108) 
[Refer to Problem A-6-9 for the derivations of Equations (6-107) and (6—108).] 
Now define 
(k) = QE) (6-109) 


By substituting Equation (6-109) into Equation (6-100), we have 
E(k + 1) = Q'(G - K. C)QẸ(k) + Q"Hu(k) + Q'K, CQ&(k)— (6-110) 
Subtracting Equation (6-110) from Equation (6—105), we obtain 
E(k + 1) -&k + 1) = (Q GQ - Q'K. CQ)E(K) — &K)) — (6-111) 
Define 
e(k) = &(k) — E(k) 
Then Equation (6-111) becomes 
e(k + 1) = Q'(G — K. C)Qe(k) (6-112) 


We require the error dynamics to be stable and e(K) to reach zero with sufficient 
speed. The procedure for determining matrix K, is first to select the desired observer 
poles (the eigenvalues of G — K, C) and then to determine matrix K, so that it will 
give the desired poles. If we require e(k) to reach zero as fast as possible, then we 
require the error response to be deadbeat, so we must select all eigenvalues of 
G — K,C to be zero. 

Notice that 


Qn-1 An-2 a 1 C kı 
An-2 An-3 1 0 CG k; 
Q'K,-| : : : 
ay 1 0 0O|| CG"? || kn- 
1 0 0 O|| CG"'!|| k, 
where 
kı 
K. = k 
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Since Q7! K, is an n-vector, let us write 


Q"K, =|” (6-113) 


Then, referring to Equation (6—108), we have 


6, 00 0 6, 
Q“ K. CQ — 9i [0 HE 1] — 0 0 see 0 E 
ôi 00 --- 0 6i 
and 
0 0 0 —, Ôn 
10 --- 0 —An- Sn 
Q'(G-K,C)Q-Q'GQ-Q"K,CQ-|0 1 - 0 -a,5- 8,5 
00-1 -aâ 


The characteristic equation 
zI - Q'(G - K. C)Q| = 0 


becomes 
zZ 0 0 0 ay + , 
-1 z 0 QO an-ı + &,4 
0 -1 z -:- 0 a,-2 + 6-2] = 0 
0 0 0 “es —-] zt+a,t+4, 
or 
z” + (a, + &)z" ! + (a + &)z" ? +--+ + (a, + 6)-70 (6-114) 
It can be seen that each of 6,,6,-1,...,6, is associated with only one of the 


coefficients of the characteristic equation. 
Suppose the desired characteristic equation for the error dynamics is 
(z — m)(z = He) (Z = Ba) 
= 277+ a,z"! + az"? +- + An-1Z + a, = 0 (6-115) 
Note that the desired eigenvalues p; (or the locations of the desired closed-loop 
poles) determine how fast the observed state converges to the actual state of the 


plant. Comparing the coefficients of equal powers of z in Equations (6-114) and 
(6-115), we obtain 


a,+ ô =a, 


a + & =a 


a, + Ôn = a, 
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from which we get 
ô = Qq — 44 


6) = aa 


Ôn = A, — An 


Then, from Equation (6-113), we have 


Ôn Qn — An 
QK, = | È | |t T ae (6-116) 
ó, a— à, 
Hence, 
Qn — An Qn — d, 
K, = QJ ^71. ^r = (WN) 9017 23 (6-117) 
o — a, o, — a 


Equation (6-117) specifies the necessary observer feedback gain matrix K,. Fig- 
ure 6—9 shows an alternative representation of the observed-state feedback control 


system. 


Figure 6-9 Alternative representation of the observed-state feedback control system. 
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Once we select the desired eigenvalues (or desired characteristic equation), the 
Observer can be designed in a way similar to the method used in the case of the pole 
placement problem. The desired characteristic equation may be chosen so that the 
Observer responds at least four or five times faster than the closed-loop system; or 
in some applications, deadbeat response may be desired. 

If we wish to have deadbeat response, the desired characteristic equation 
becomes 


z"-0 (6-118) 
Comparing Equation (6-114) with Equation (6-118), we require that 
a,+ 6, =0 
a+ 6&=0 
a, + 6, = 0 
Hence, for the deadbeat response, 
ki Ô, —, 
K, =|?) = Q| | = (wwe? 7t (6-119) 
k, 5, =d 


Ackermann's Formula. The expression given by Equation (6-117) is not the 
only one commonly available for the determination of the observer feedback gain 
matrix K,. In what follows, we shall derive Ackermann's formula for the determi- 
nation of K,. 

Consider the completely observable system defined by Equations (6—98) and 
(6-99). Note that in this system the output y(K) is a scalar. Referring to Equation 
(6—112), the characteristic equation for the error dynamics is 


l1- Q'GQ + Q'K,CQ| = 0 (6-120) 
where K, is an n X 1 matrix. Define 
Q'GQ-G, Q^?K,-ÉK, CQ-C 
Then Equation (6-120) becomes 
l1- 6 - K, | =0 


In the observer design we determine matrix K, so that this last charac- 
teristic equation is identical to the desired characteristic equation for the error 
vector, which is 


z” + az +++ + aaz + a, =0 (6-121) 
That is, 
zI- Ĝ + K, Ĉ| = (z m uj) E m) (z FE Hn) 


= z" + az! + +t aztan =0 
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where 4, uo, . . . , Hn are the eigenvalues of matrix (6 — É, €). For physical systems, 
complex eigenvalues always occur as conjugate complex pairs. In the present analysis 
we assume that all complex eigenvalues occur as conjugate complex pairs so that the 
coefficients a, 05, .. . , a, of the characteristic equation are real. Then the character- 
istic equation for the matrix (G* — C*K?) can be given by 


lii - G* + C*K?| = (z - )(2 — To) + (2 — Ta) 
=z" + az"! + + aaz +a 


where 4; is the complex conjugate of w. 

In Section 6-5 we derived Ackermann’s formula for the determination of the 
state feedback gain matrix K for the pole placement design problem. There we 
determined matrix K so that the characteristic equation 


lzI — G + HK| - 0 


would be the same as the desired characteristic equation, Equation (6-121). Here, 
in the observer design problem, we wish to determine matrix K* so that the char- 
acteristic equation 


[z1 - G* + €*K?| = 0 
will be the same as the desired characteristic equation given by Equation (6- —121). 
Clearly, we can see that these two problems are a dual problem. (That is, mathemat- 
ically, the determination of matrix K* is the same as the determination of the 
feedback gain matrix K in the pole placement problem.) Therefore, it is possible to 
utilize the results obtained in Section 6-5 toward the determination of matrix K, for 
the present problem, as will be shown. 


In the pole placement design problem discussed in Section 6—5, for the system 
equation 


x(k + 1) = Gx(k) + Hu(k) 
with state feedback 


u(k) = —Kx(k) 
the desired matrix K was obtained as given by Equation (6-68), repeated here: 
-[0 0 --- 0 1)[H:GH:---:G"'H]' 9(G) (6-122) 


Here, in the observer design problem, for the state equation 
x(k + 1) = G*x(k) + C*u(k) 
with state feedback 
u(k) = -K? x(k) 


the desired matrix K: can therefore be obtained in a form similar to Equation 
(6-122), as follows: 


Kr =(0 0 -- 0 1[€C*:65€9:-.-:(G9y-7 C9]! 6(G*) — (6-123) 
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which may be modified to 


Kx =[0 0 +--+ 0 1J[C*:G*C*:---:(G*)"! C*] (Q9) ! 9 (G*) 
By taking the conjugate transpose of both sides of this last equation, we have 
c |'[o 
k. = [6*9 | S | |? 
ce] [1 
Noting that 
Q"K, =É, 
we obtain 
c [|'[o 
K, = Q| E | |? (6-124) 
ce] |1 


Notice that, since G = Q^! GQ, we have 
QG'Q"-G*  k-70,12,...,n 
Consequently, 
Q9(G)Q"! - Q[G" +a, 67! + -e + iG + a Q7? 
-Q6'Q'-a,Q67!Q" + +++ + @1Q6Q7 + a, I 
= G” + aG! +- + aG + aI = (G) (6-125) 


By use of Equation (6-125), the desired observer feedback gain matrix K,, given by 
Equation (6—124), can be rewritten as follows: 


c [fo 
K = 46), *9 | |? (6-126) 
CG"! 1 


where $(G) is the desired characteristic polynomial of the error dynamics. The 
expression for K, given by Equation (6-126) is commonly called Ackermann’s 
formula for the determination of the observer feedback gain matrix K,. 


Summary. The full-order prediction observer is given by Equation (6-92): 
K(k + 1) = (G — K. C)x(k) + Hu(k) + K. y(k) 
The observed-state feedback is given by 
u(k) = —Kx(k) 
If this last equation is substituted into the observer equation, we obtain 


x(k + 1) = (G — K.C - HK)&(k) + K, y(k) 
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This equation defines the full-order prediction observer when the observed-state 
feedback control is incorporated. 

As in the case of the pole placement design four methods, that are commonly 
available for the determination of the observer feedback gain matrix K, for the 
completely observable system, are summarized as follows: 


1. Referring to Equation (6-117), the observer feedback gain matrix K, can be 


given by 
An — d, On — An 
K.=Q Qn-1 " s-1| _ (WN*)7! On-1 = an-1 (6-127) 
a S a 03 Š ay 


where matrices N and W are defined by Equations (6-102) and (6-103), 
respectively. The a; ’s are the coefficients of the desired characteristic equation 


z” + az! + ee + aaz tan =O 


and the a; ’s are coefficients of the characteristic equation of the original state 
equation 


jI - G| = z" + az"! +... + aniz +a, =0 
Note that if the system is already in an observable canonical form then 
the matrix K, can be determined easily, because matrix WN* becomes an 
identity matrix, and thus (WN*) ! = I. 
2. The observer feedback gain matrix K, may be given by Ackermann's formula, 
given by Equation (6-126): 
c T'o 


Kod See 


(6-128) 
ce} |1 
where 
$(G) = G+ |G"! +--+ + a,16 + aI 
3. If the desired eigenvalues jy, u2, . . . , Mn of matrix G — K, C are distinct, then 
the observer feedback gain matrix K, may be given by the equation 


N a 
Kee | ey (6-129) 
m) li 
where the n;’s are defined as follows: 
a = C(G - wD” 


Note that the «e are the eigenvectors of matrix (G — K, C)*. 
In the special case where we desire the error vector to exhibit deadbeat 
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response, so that u, = {y = ++: = mw, = 0, Equation (6-129) can be simplified. 
The following equation will give the matrix K, for the deadbeat response: 
Thi “Fa 
K,=1®] [9 (6-130) 
m] Lo 
where the n;’s are given by the equation 
n; = CG", i=1,2,3,...,n 


[For details of the derivations of Equations (6-129) and (6-130), see Problems 
A-6-12 and A-6-13.] 
4. If the order of the system is low, assume an observer feedback gain matrix K, 


with unknown elements. Then the elements of matrix K, may be determined 
by equating the coefficients of like powers of z of 


lz1 — G + K,C| 
and of the desired characteristic polynomial, which is given by 
(z = a) = pa) (Z = Mn) = Z" + az" He + Aaz + Oy 
where the y;’s are the desired eigenvalues of G — K, C. 
Example 6-10 
Consider the double integrator system given by the equations 
x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) 


1T T 
s-|i r] a-[77 |, c-[1 0] 


and T is the sampling period. (See Problem A-5-16 for the derivation of the discrete- 
time state-space equations for the double integrator system.) Assuming that the ob- 
server configuration is the same as that shown in Figure 6-8, design a state observer 
for this system. It is desired that the error vector exhibit deadbeat response. Use the 
four different methods listed in the foregoing discussion. 

First we check the observability condition. Notice that the rank of 


[c*:c*cs] = D 5 


is 2. Hence, the system is completely observable. Next we examine the characteristic 
equation for the system: 


J- i- 


Comparing this characteristic equation with 


where 


Zeal =F 


|zI — G| = 0 pase 


=z*-2z7+1=0 


2+azt+a=0 
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we obtain 
a, = —2, a=1 


Since the deadbeat response is desired, the desired characteristic equation for the error 
dynamics is 


P+aztm=a2=0 
Thus, 


a= 0, a = 0 
Method 1. Referring to Equation (6-127), we have 
= x\-1| 92 — 02 Zs )\—1 -1 
K. = (WN*) l2 = s (WN*) | l 
where N and W, defined by Equations (6-102) and (6-103), respectively, are 


N= [c+:c*c] = |i A 


[|a 1 _ —2 1 
Mm | 1 J z | 1 ] 
Hence, the observer feedback gain matrix K. is obtained as follows: 
«-[ gere pnr 
10]|1 T 2 TT 2 
Method 2. From Equation (6—128), Ackermann's formula, K. is given by 


«ofS [2 


ó(G) = CG + aG + œl = G? 


Hence, the observer feedback gain matrix K, is obtained as follows: 


[E TE 


and 


Mie S 


where 


Method 3. Since deadbeat response is desired, from Equation (6—130) we have 


where 
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Notice that 


The vectors «y; and m are obtained as follows: 
2 1 P mous 
m= [1 al Sle T) 


v = [1 oa | =[1 al FOLE -2T] 


Thus, the observer feedback gain matrix K. is obtained as follows: 


-1 2 -1 

MEX -r ji] Pl 

kc 2 EE M: EE 
T T 


Method 4. We assume 


l^ N 


and expand the characteristic equation as follows: 


do t]-[ ijela ol 


T | 
kp zc 


zI- G * K,C] = 


=2?+(k, -2)z+1-h+khT=0 


Since we desire the deadbeat response, this characteristic equation must be equal to 
2=0 
Thus, 
1 
kı = 2, k2 = T 
or 


e= [elar] 


Let us verify that the error vector reduces to zero in at most two sampling periods. 
Note that the coefficient matrix for the error equation becomes 


2 -1 T 

G-K.C= ME 1 [1 0]= 1 
0 1 md = 
T T 


o= fa] 


where a, and b, are arbitrary and x(0) is assumed as 


v-[7 


If the initial state x(0) is given as 
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where a; and b; are arbitrary, then 


e(0) = x(0) — &(0) = E 7 2 - H 


where a and b are arbitrary constants. Now Equation (6-95) becomes 


e(k*0l |71 Telk e(0]. fa 
ek -0|- -4 ille. e07 | 


The vectors e(1) and e(2) are found as follows: 


Bae a leis De 

ex1) -7 115 -14*b 

and 
EAE Es T Eu K A sr] 
ex(2) -7 1 -14*b zi -b path 0 


Clearly, the error vector e(k) becomes zero in at most two-sampling periods. Thus, the 

response is deadbeat. Note that for any initial state x(0) the observed-state vector 

becomes identical to the actual state vector in at most two sampling periods. 
Finally, the observer equation is 


aep Taw], E 2 
Ease -1 ABE 2 u(kT) + d 


[Note that this is the equation given by Equation (6—93).] 


Comments on Selecting the Best K,. Referring to Figure 6—8, notice that the 
feedback signal through the observer feedback gain matrix K, serves as a correction 
signal to the plant model to account for the unknowns in the plant. If significant 
unknowns are involved, the feedback signal through the matrix K, should be rela- 
tively large. However, if the output signal is contaminated significantly by distur- 
bances and measurement noises, then the output y(K) is not reliable and the feed- 
back signal through the matrix K, should be relatively small. In determining the 
matrix K, (which depends on the desired eigenvalues p, 42, ..., n), we should 
carefully examine the effects of disturbances and noises involved in the output y(K). 

Remember that the observer feedback gain matrix K, depends on the desired 
characteristic equation 


f(z) = (z - 1) — n: (z — 4) = 0 


The choice of a set of p11, H2, ... , Mn is not unique. Hence, many different character- 
istic equations might be chosen as desired characteristic equations. For each desired 
characteristic equation, we have a different matrix K,. 

In the design of the observer, it is desirable to determine several observer 
feedback gain matrices K, based on several different desired characteristic equa- 
tions. For each of the several different matrices K,, simulation tests must be run to 
evaluate the resulting system performance. Then we select the best K, from the 
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viewpoint of overall system performance. In many practical cases the selection of the 
best matrix K, boils down to a compromise between speedy response and sensitivity 
to disturbances and noises. 


Effects of the Addition of the Observer on a Closed-Loop System. In the pole 
placement design process, we assumed that the true state x(k) was available for 
feedback. But in practice the true state x(k) may not be measurable, so we will need 
to use the observed state x(k). Let us now investigate the effects of the use of the 
observed state x(k) rather than the true state x(k) upon the characteristic equation 
of a closed-loop control system. 

Consider the completely state controllable and completely observable system 
defined by the equations 


x(k + 1) = Gx(k) + Hu(k) 


y(k) = Cx(k) 
For the state feedback control based on the observed state x(k), we have 
u(k) = ~—Kx(k) 


With this control the state equation becomes 
x(k + 1) = Gx(k) — HK&(k) = (G — HK)x(k) + HK[x(k) — x(k)] (6-131) 


The difference between the actual state x(k) and the observed state x(k) has been 
defined as the error e(k): 


e(k) = x(k) — &(k) 


By substitution of the error vector e(k), Equation (6-131) becomes 


x(k + 1) = (G — HK)x(k) + HKe(k) (6-132) 
Note that the observer error equation was given by Equation (6-95), repeated here: 
e(k + 1) = (G — K, C)e(k) (6-133) 


Combining Equations (6—132) and (6-133), we obtain 


[eto E e keke] 


This equation describes the dynamics of the observed-state feedback control system. 
The characteristic equation for the system is 


[eoe nk -HK 4 
0 zI- G 4 K,C 
Or 
zI - G + HK||zI - G + K,C| = 0 (6-134) 


Notice that the closed-loop poles of the observed-state feedback control system 
consist of the poles due to the pole placement design alone plus the poles due to the 
observer design alone. This means that the pole placement design and the observer 
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design are independent of each other. They can be designed separately and com- 
bined to form the observed-state feedback control system. 

The desired closed-loop poles to be generated by state feedback (pole place- 
ment) are chosen in such a way that the system satisfies the performance require- 
ments. The poles of the observer are usually chosen so that the observer response 
is much faster than the system response. A rule of thumb is to choose an observer 
response at least four to five times faster than the system response or in some cases 
to choose all observer poles at the origin (for deadbeat response). Since the observer 
is, in general, not a hardware structure but is programmed on the computer, it is 
possible to increase the response speed or achieve deadbeat response so that the 
observed state quickly converges to the true state. The maximum response speed of 
the observer is generally limited only by noise and sensitivity problems involved in 
the control system. 


Current Observer. In the prediction observer the observed state x(k) is ob- 
tained from measurements of the output vector up to y(k — 1) and of the control 
vector up to u(k — 1). Hence, the control vector u(k) = —Kx(k) does not utilize the 
information on the current output y(K). A different formulation of the state observer 
is to use y(k) for the estimation of x(k). This can be done by separating the 
observation process into two steps. In the first step we determine z(k + 1), an 
approximation of x(k + 1) based on x(k) and u(k). In the second step, we use 
y(k + 1) to improve z(k + 1). The improved z(k + 1) is x(k + 1). The state ob- 
server based on this formulation is called the current observer. 

Consider the completely state controllable and completely observable system 
defined by the equations 


x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) 
where 
x(k) = state vector (n-vector) 
u(k) = control vector (r-vector) 
y(k) = output vector (m-vector) 
G =n X n matrix 
H = n X r matrix 
C = m X n matrix 
The current observer equations are given by 
K(k + 1) = z(k + 1) + K.[y(k + 1) — Cz(k + 1)] (6-135) 
z(k + 1) = Gx(k) + Hu(X) (6-136) 


Equation (6-136) gives the prediction z(k + 1) based on x(k) and u(k) at stage k. 
Equation (6-135) states that by measuring y(k + 1) we can improve z(k + 1) to 
obtain x(k + 1). 
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Define the observer error e(k) as follows: 
e(k) = x(k) — x(k) 
Then 
e(k + 1) = x(k + 1) — &(k + 1) 
= Gx(k) + Hu(k) — (Gx(k) + Hu(k) + K.(C[Gx(k) + Hu(X)] 
- C[G&(k) + Hu()])) 
= (G - K., CG)[x(k) — x(k)] 
= (G - K. CG)e(k) 


Thus, the observer error equation for the current observer is similar to that for the 
prediction observer given by Equation (6-95). However, a difference appears in the 
error dynamics. The matrix K, can be obtained exactly as in the case of the prediction 
Observer except that matrix C is replaced by matrix CG. To make it possible for the 
eigenvalues of (G — K, CG) to be arbitrarily placed, the rank of the matrix 


CG C 
2 

ce. | ce |, 

CG'| [ce 


must be n. Notice that if matrix G is nonsingular then this condition is equivalent 
to the observability condition, or 


If the rank of the observability matrix is n, then the eigenvalues of G — K, CG 
can be arbitrarily located by a proper choice of K,, and matrix K, can be determined 
in a way similar to what was done in the case of the prediction observer. In 
determining matrix K,, we replace matrix C by CG in the computations involved. 
For example, if the output y(k) is a scalar, then Ackermann's formula as given by 
Equation (6-126) is altered to the corresponding form: 

-1 


CG 0 
ce | lo 

K,-4(G) : : (6-137) 
ce" | |o 
ce" | li 


However, if matrix G is singular, then the rank of 


is g, which is less than n. In this case, let us write 
(G — K. CG)* = G* — G*C*K? = G* — BK? 


where B = G*C*. Note that matrix (G* — BK?) is of the same form as matrix 
(G — HK), which played an important role in the pole placement design. 
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With an analysis similar to that given in Section 6-5 [refer to Equations (6-55) 
and (6—57), it is possible by use of a suitable transformation matrix T to transform 
matrices G and B into G* and B, where 


G* = T? G*T = Em B-T^?B- e] 


and where all eigenvalues of the uncontrollable (n — q) X (n — q) matrix G% can 
be made zero. (Hence, the system can be stabilized.) Next, define 


K? T= K? = [Ki : Kà] 


Then 
A AA Gh iG B 
G* — BK? = Er m | akik 212 
[Gh -Bu Rå; | Gh — Bi Kin 
9 i Gh 


Hence, if matrix G is singular and the rank of the observability matrix is q, then we 
need to specify only q eigenvalues of the q X q matrix Gf; — By, Kyi. 


Minimum-Order Observer. The observers discussed thus far are designed to 
reconstruct all the state variables. In practice, some of the state variables may be 
accurately measured. Such accurately measurable state variables need not be esti- 
mated. An observer that estimates fewer than n state variables, where n is the 
dimension of the state vector, is called a reduced-order observer. If the order of the 
reduced-order observer is the minimum possible, the observer is called a minimum- 
order observer. 

Suppose the state vector x(k) is an n-vector and the output vector y(k) is an 
m-vector that can be measured. Since m output variables are linear combina- 
tions of the state variables, m state variables need not be estimated. We need to 
estimate only n — m state variables. Then the reduced-order observer becomes an 
(n — m)th-order observer. Such an (n — m)th-order observer is the minimum-order 
observer. Figure 6-10 shows the block diagram of a system with a minimum- 
order observer. 

It is important to note, however, that if the measurement of output variables 
involves significant noises and is relatively inaccurate then the use of the full-order 
observer may result in a better system performance. 

The minimum-order observer can be designed by first partitioning the state 
vector x(k) into two parts, as follows: 


where x,(k) is that portion of the state vector that can be directly measured [thus, 
x(k) is an m-vector] and x,(k) is the unmeasurable portion of the state vector [thus, 
x,(k) isan (n — m)-vector]. Then the partitioned state equations become as follows: 


kes enrike laho e 
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u(k) 


y(k) 


T i 3 Miminum-order 
—— 
ransformation observer 


y(k) 


Figure 6-10 Observed-state feedback control system with a minimum-order observer. 


y(k) = [E vx (6-139) 
where 
G,, =m X m matrix 
Ga = m X (n — m) matrix 
G,, = (n — m) X m matrix 
Gy, = (n — m) X (n — m) matrix 
H, = m X r matrix 


H, = (n — m) X r matrix 


By rewriting Equation (6-138), the equation for the measured portion of the state 
becomes 


X,(k + 1) = Gau x,(k) + Ga x(k) + H, u(k) 


or 


x,(k + 1) — Ga x,(k) — Ha u(k) = Ga x(k) (6-140) 


where the terms on the left-hand side of the equation can be measured. Equation 
(6-140) acts as the output equation. In designing the minimum-order observer, we 
consider the left-hand side of Equation (6-140) to be known quantities. In fact, 


Equation (6-140) relates the measurable quantities and the unmeasurable quantities 
of the state. 
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From Equation (6-138), the equation for the unmeasured portion of the state 

becomes 
x,(k F 1) Te Goa x,(k) + Gop x(k) F H, u(k) (6-141) 


Equation (6-141) describes the dynamics of the unmeasured portion of the state. 
Notice that the terms G,, x,(k) and H, u(k) are known quantities. 

The design of the minimum-order observer can be facilitated if we utilize the 
design technique developed for the full-order observer. Let us now compare the state 
equation for the full-order observer with that for the minimum-order observer. The 
state equation for the full-order observer is 


x(k + 1) = Gx(k) + Hu(k) 
and the “state equation” for the minimum-order observer is 
x(k + 1) = Gop xs(k) + [Gra xa(k) + H, u(k)] 
The output equation for the full-order observer is 
y(k) = Cx(k) 
and the “output equation" for the minimum-order observer is 
x,(k + 1) — Ga Xalk) - Ha u(k) = Ga x,(k) 


The design of the minimum-order observer can be carried out by making the 
substitutions given in Table 6-1 into the observer equation for the full-order observer 
given by Equation (6—93), which we repeat here: 


K(k + 1) = (G - K, C)X(k) + Hu(k) + K. y(k) (6-142) 
Making the substitution of Table 6-1 into Equation (6-142), we obtain 
%(K + 1) = (Gu ~ K.Go)X(k) + Goo x,(k) + H, u(k) 
+ K,[x,(k + 1) — Ga x,(k) — Ha u(k)] (6-143) 


TABLE 6-1 LIST OF NECESSARY SUBSTITUTIONS FOR WRITING 
THE OBSERVER EQUATION FOR THE MINIMUM-ORDER 
STATE OBSERVER 


= Pe 
ME 
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where the observer feedback gain matrix K, is an (n — m) x m matrix. Equation 
(6-143) defines the minimum-order observer. 
Referring to Equation (6-139), we have 


y(k) = x.(k) (6-144) 
Substituting Equation (6-144) into Equation (6-143), we obtain 
X,(k + 1) = (Gy, — K, Go)X,(k) + Ke y(k + 1) 
+ (Goo ~ K.G,,)y(k) + (H, — K.H,)u(k) (6—145) 


Notice that to estimate X,(k + 1) we need the measured value of y(k + 1). This is 
inconvenient, and so we may desire some modifications. [In the case of the full-order 
observer, x(k + 1) can be estimated by use of measurement y(k) and does not 
require measurement of y(k + 1). See Equation (6—93).] Let us rewrite Equation 
(6—145) as follows: 


X,(k + 1) — K.y(k + 1) = (Gy, — K. Gas) (kK) + (Goa — Ke Gaa)y(k) 
+ (H, — K, H,)u(k) 
= (Gs — K.G)[£,(k) — K.y(k)] + (Gs — K.G.»)K.y(k) 
+ (Goa — Ke Gaa)y(k) + (H, — K, H,)u(k) 
= (G» ~ K, Gas)[%o(K) - Ke y(k)] + [(Gos — K, Gas) Ke 
+ Goo ~ Ke G,]y(k) + (H, — K. H;)u(&) (6-146) 
Define 
xo(k) — K. y(k) = xo(k) - K.x,(k) = n(k) (6-147) 
and 
X,(k) — Ke y(k) = X,(k) — K.x,(k) = (k) (6-148) 
Then Equation (6—146) can be written as follows: 
Wk + 1) = (Gy - K.Ga)a(k) + [(Gu — K,G;)K, + Gog 
- K, G,]y(X) + (H, — K, H,)u(k) (6-149) 


Equations (6-148) and (6-149) define the dynamics of the minimum-order observer. 
Notice that to obtain 4(k + 1) we do not need the measured value of y(k + 1). 
Let us next obtain the observer error equation. Define 


e(k) = n(k) ~ «(k) = x(k) — &,(K) (6-150) 
Subtracting Equation (6~143) from Equation (6-141), we obtain 
x(k + 1) — X,(k + 1) = Gu[x;(k) — X,(k)] + Ke Gas x,(k) 
—K,[x.(k + 1) - Gaxe(k) — H, u(k)] 
By substituting Equation (6-140) into this last equation, we obtain 
Xo(k + 1) — xk + 1) = Gu[xs(k) — &(k)] + Ke Gas X,(k) — Ke Gos x(k) 
= (Gy, — K. Go)[x,(k) — x5(k)] 
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This last equation can be written in the form 
e(k + 1) = (Gy, - K. Ga)e(K) (6-151) 


This is the observer error equation. Note that e(k) is an (n — m)-vector. The error 
dynamics can be determined as desired by following the technique developed for the 
full-order observer, provided that the rank of matrix 


Ga 
Gas Gro 


n-m-1 
Gu Gis 


isn — m. (This is the complete observability condition applicable to the minimum- 
order observer.) 

The characteristic equation for the minimum-order observer is obtained from 
Equation (6-151) as follows: 


zI X Gop F K. Gal =0 (6-152) 


The observer feedback gain matrix K, can be determined from Equation (6-152) by 
first choosing the desired closed-loop pole locations for the minimum-order observer 
[that is, by placing the roots of the characteristic equation, Equation (6—152), at the 
desired locations] and then using the procedure developed for the full-order predic- 
tion observer. 

If, for example, the output y(K) is a scalar, then x,(k) is a scalar, Ga is a 
1 x (n — 1) matrix, and G» is an (n — 1) x (n — 1) matrix. For this case, Acker- 
mann's formula as given by Equation (6-126) may be modified to read 


Gs. T^[0 
Gu Gp, 0 
K, = b(Gip) : : (6-153) 
Gu G5 0 
Gas Gis” 1 
where 
(Gro) = Gi; + aG + +++ + an-2G + anil (6-154) 


Summary. Once the observer feedback gain matrix K,, which is an 
(n — m) X m matrix, is determined, then the minimum-order observer can be 
defined by Equations (6-148) and (6-149): 


&(k) = H(k) + K. xak) 
Ak + 1) = (Go — Ke Ga)a(k) + [Go — Ke Gas)K. + Goa — Ke Gaaly(k) 
+ (H, - K, H,)u(k) 


Equivalently, in terms of e(k) rather than (X), the minimum-order observer can be 
defined by Equations (6—150) and (6—151): 


X,(k) = x,(k) — e(k) (6-155) 
e(k + 1) = (Gu — Ke Gas)e(k) (6-156) 
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Observed-State Feedback Control System With Minimum-Order Observer. Con- 
sider the completely state controllable and completely observable system given by 


x(k + 1) = Gx(k) + Hu(k) (6-157) 
y(k) = Cx(k) (6-158) 


where x(k) is an n-vector, u(k) is an r-vector, and y(k) is an m-vector. Matrices G, 
H, and C are given by 


Consider the state feedback control scheme where the fed back state consists of the 
measured portion of the state and the observed (estimated) portion of the state 
obtained by use of the minimum-order observer. Figure 6—11 shows the block 
diagram for the system. In this system the control vector u(k) is given by 


u(k) = —Kx(k) (6-159) 


Figure 6-11 State feedback control scheme where the fed back state consists of the measured 
portion of the state and the observed portion of the state obtained by use of the minimum-order 
observer. 
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where x(k) consists of the measurable state x,(k) and unmeasurable (observed) 
state x,(k): 


«o - [249] - [su t oso oe) 
By substituting Equation (6-159) into Equation (6-157), we obtain 
x(k + 1) = Gx(k) — HKx(k) = (G — HK)x(k) + HK[x(k) — x(k)] (6-161) 
Notice that 


«6 -6) = [96] - EB | - [zs o] = [ete 
where e(k) = x(k) — Xi(k). Define 


Then, by use of this matrix F, Equation (6-161) can be rewritten as follows: 
x(k + 1) = (G — HK)x(k) + HKTe(k) (6-162) 


Equations (6-162) and (6-156) characterize the state feedback control system where 
the fed back state consists of the measured portion of the state, x,(k), and the 
observed portion of the state, X,(k), obtained by use of the minimum-order ob- 
server. Combining Equations (6—162) and (6-156), we have 


[eB] = [e Hei mE 9] ree 


Equation (6-163) characterizes the dynamics of the system with observed-state 
feedback using a minimum-order observer. The characteristic equation for the 
system is 


z1 - G - HK i -HKT 


0 i zl - Gy + K. Go 
= \zI -G+ HK| jzI = Gap + K, Gal =0 (6-164) 


Equation (6-164) implies that the closed-loop poles of the system comprise the 
closed-loop poles due to pole placement [the eigenvalues of matrix (G — HK)] and 
the closed-loop poles due to the minimum-order observer [the eigenvalues of matrix 
(Gss - K. G,)]. 


Example 6-11 


Consider the discrete-time double integrator system defined by the equations 
x(k 1) = Gx(k) + Hu(k) (6-165) 
y(k) = Cx(k) (6-166) 


where the sampling period T is assumed to be 0.2 sec, or T = 0.2, and 


T? 
e g- Emp EE enn 
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By use of the pole placement design technique, determine the state feedback gain 
matrix K to be such that the closed-loop poles of the system are located at 


zı = 0.6 + j0.4, za = 0.6 — j0.4 


Assuming that the output y(k) = x(k) is the only state variable that can be measured, 
design a minimum-order observer such that the error signal will exhibit a dead- 
beat response to an arbitrary initial error. Determine the pulse transfer function for 
the controller (which consists of the state feedback control and the minimum-order 
observer). 

We shall first examine the controllability and observability of the system. Since 
the rank of the matrices 


un [0.02 0.06 cu fl 1 
micu] -|63 0.2 I iiec) = [1 A 


is 2 in both cases, the system is completely state controllable and observable. 
We shall now solve the pole placement portion of the problem. Since 


z—1 -02 


Jel - G| = 0 z-1 


=2-2+1=2+az2z2+a=0 


we have 
a, = —-2, a=1 
The desired characteristic equation is given by 
|zI - G + HK| = (z — 0.6 — j0.4)(z — 0.6  j0.4) = z? — 1.2z + 0.52 
=2+azt+a=0 
Hence, 
a, —1.2, a» = 0.52 
From Equation (6—65), the state feedback gain matrix K is obtained as follows: 


K = [œ — a} a — ai]T = (70.48. 0.8]T™ (6-167) 


where 
_ raze 1] [0.02 o.06]f-2 1 
T = (acu 4 i= [03 0.2 | 1 ] 
.[ 0.02 0.02 
-02 02 
and 


-,_|25 -2.5 
T = E 25] 
Thus, the state feedback gain matrix K given by Equation (6—167) becomes 
Lr 25 -2.5| _ 
K - [-0.48 TE as] = [8 3.2] 
The feedback control signal can then be given by 
u(k) = -KX(k) 


- -[8 32 200 | = -[8 sape (6-168) 
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Next, we shall solve the observer portion of the problem. Since the state x(k) is 
a 2-vector and the output y(k) is a scalar, the minimum-order observer is of the first 


order. Notice that 
Gea | Gay | 11:02 Ha | _ | 0.02 
Goa ! Gop 0 i 1 ? H, 0.2 


Since we desire deadbeat response, the desired characteristic equation for the ob- 
server is 


(z) =z =0 
Referring to Ackermann’s formula as given by Equation (6-153), we obtain 
K. = $(Go)[Ga] [1] = (0(0.2) (0) = 5 
Referring to the minimum-order observer equation given by Equation (6-149), we have 
Ak + 1) = (Go — Ke Ga)n(k) + [(Gos — Ke Gao)Ke + Goa — Ke Ga] y(k) 
+ (H, — K.H,)u(k) 
= (1-5 x 0.2)n(k) + [(1 — 5 x 0.2) x 5+ 0 — 5 x 1]y(k) 
+ (0.2 — 5 x 0.02)u(k) 
which can be simplified to read 
nlk + 1) = —5y(k) + 0.lu(k) (6-169) 


Equation (6-169) defines the minimum-order observer. 
The observed-state feedback control u(k) is now given by 


u(k) = -Kx(k) = —8x,(k) — 3.2%2(k) = —8y(k) — 3.2%2(k) (6-170) 
where, referring to Equation (6-148), 
X2(k) = Key(k) + *(&) = Sy(k) + m(&) (6-171) 


The block diagram for the system is shown in Figure 6-12. From Equations (6-169), 
(6-170), and (6-171), we obtain 


u(k + 1) = —8y(k + 1) — 32[5y(k + 1) + A(k + 1)] 
= —24y(k + 1) + 16y(k) — 0.32u(k) 
or 
u(k + 1) + 0.32u(k) = —24y(k + 1) + 16y(k) 


By taking the z transform of this last equation, assuming zero initial conditions, we 
obtain 


zU(z) + 0.32U(z) = -24zY(z) + 16Y(z) 


The pulse transfer function of the regulator is 


U(z z — 0.6667 1 - 0.6667z ! 
Gae) =~ Fay = (2e) = (1268) (6-172) 


By referring to Equation (5-60), the pulse transfer function of the system defined 
by Equations (6—165) and (6—166) can be obtained as follows: 
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Double integrator system 


Minimum-order observer 


Figure 6-12 Block diagram of the system designed in Example 6-11. 


YG) 
U(z) 


= G,(z) = CzI - G)” H 

z-1 -02] [0.02 
ic ol 0 z 2 pe | 
_ 0.02(z +1) 0.02(1*z )z" 
a c E T S. 


By using the pulse transfer functions of Equations (6-172) and (6-173), the block 
diagram of Figure 6-12 may be modified to the form shown in Figure 6-13. 
Using the form given by Equation (6-164), 


|zI — G + HK||z — Gss + K.Ga| = 0 


(6-173) 


we have obtained the following characteristic equation for the system: 
(z? — 1.2z + 0.52)(z — 1 + 5x 0.2) = (z? - 1.2z + 0.52)z = 0 (6-174) 
The characteristic equation for the closed-loop system shown in Figure 6-13 is 
1+ G,(z)Gp(z) = 0 
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0.02(1 + z 7!)27! 
ü-2z 


= -1 
= ( 0.66672 ) 
1 0.3227 


— Gpiz) 


Figure 6-13 Modified form of the block diagram of the system designed in 
Example 6-11. 


or 


0.02(1 + z z^! 1 — 0.6667z7*\|} _ 
i | (- z`”? A 190327 A 9 


which can be written as follows: 


presse] 

And, as a matter of course, this characteristic equation can be simplified to 
(z? — 1.2z + 0.52)z - 0 

which is the same as Equation (6-174), obtained by use of Equation (6-164). 


Control System With Reference Input. We shall apply the observed-state feed- 
back method to design control systems that must follow changing reference inputs. 

It is important to point out that the pole placement with observed state 
approach has no control over the numerator dynamics of the closed-loop system. (To 
control the numerator dynamics, refer to the polynomial equations approach pre- 
sented in Chapter 7.) However, it is possible to modify an observed-state feedback 
regulator system to a control system, as shown in Figure 6-14. 

As stated earlier, the pole placement part determines the desired nth-degree 
characteristic equation for the nth-order system. The state observer part determines 
the observer error characteristic equation of degree n or less. As given by Equation 
(6-134) or (6-164), the product of the nth-degree characteristic equation and the 
state observer error characteristic equation gives the characteristic equation for the 
entire system. 

In modifying the regulator system to the control system, it is necessary to 
provide an adjustable gain Ko in the input path so that the gain of the entire control 
system can be determined such that the steady-state output to a unit-step input is 
unity. This is because the pole placement with state observer modifies the gain of 
the entire system. Therefore, unless Ky is properly adjusted, the system will not 
behave properly. 
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r(k) 


X (k 41) = G x(k)  H u(k) 


Figure 6-14 Block diagram of a control system with observed-state feedback. 


Example 6-12 


Modify the regulator system considered in Example 6-11 to a control system such that 
the output will follow the reference input. Then obtain the unit-step response and 
unit-ramp response of the control system. (Assume that the sampling period T is 0.2 
sec, or T = 0.2.) 

Figure 6-15 shows a possible block diagram of the control system. In this control 
system, it is necessary to set gain Ko so that there will be no offset in the output to step 
input. (Note that if Ko = 1 then the steady-state output to a unit-step input will not be 
equal to unity, except in special cases.) 

From the block diagram the closed-loop pulse transfer function Y(z)/R(z) is 


Y(z) _ K,(0.02)(z + 0.32)(z + 1) 

R(z) (z — 1) (z + 0.32) + 0.48(z + D)(z — 0.6667) 
_ Ko(0.02)(z + 0.32)(z + 1) 
i z? — 1.227 + 0.52z 


The system is of third order. 

Before we examine the system behavior, it is necessary to determine the gain 
constant Ko. Let us assume that R(z) is the z transform of the unit-step sequence. Then 
the steady-state output is given by 


0.02(z + 1) 
(z- 1)? 


Figure 6-15 Control system obtained by modifying the block diagram shown in 
Figure 6-13. 


458 


Pole Placement and Observer Design Chap. 6 


lim y(k) = lim[(1 — z )Y()] 
= wn Kot aL (Cs +1) z 
zi Z z* — 1.2z^ + 0.52z z-—1 

= 0.165 Ko 

We set the gain Ko such that 
y(») = 0.165Ko = 1 
or 
Ko = 6.0606 

By substituting Ko = 6.0606 into the closed-loop pulse transfer function, we obtain 


Y(z) 0.12122 + 0.16z + 0.03879 
R(z) z? — 1.227 + 0.52z 


The unit-step response of this system can be obtained easily with MATLAB. A 
sample MATLAB program for obtaining the unit-step response is shown in MATLAB 
Program 6-2. The resulting unit-step response is shown in Figure 6-16. 


MATLAB Program 6~2 


num = (0 0.1212 0.1600 0.03879]; 
den=[1 -1.2 0.52 0]; 
r = ones(1,41); 

ve [0 40 0 1.6]; 
axis(v); 

k = 0: 40; 

y = filter(num,den,r); 
plotk,y,'o') 

grid 

title('Unit-Step Response!) 
xlabel('k') 

ylabel('y(k)") 


Also, the unit-ramp response can be obtained by entering MATLAB Pro- 
gram 6-3 into the computer. The resulting unit-ramp response is shown in Figure 6-17. 
The error following the unit-ramp input is obtained as follows: Noting that the 
sampling period T is 0.2 sec, the unit-ramp input is given by 
0.22! 
R(z) = (peau 
Then we obtain 
" B YG) 
E(z) = R(z) - Y(z) = |: rO ng; 


_ Z? — 1.32122? + 0.36z — 0.03879 _0.2z 
z? — 1.227 + 0.52z (z -17 

_ (z = 1)(z? — 0.3212z + 0.03879) _0.2z 

3 z — 1.2z? + 0.52z (z - 1) 


Jy» 
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Figure 6-16 Unit-step response of the control system shown in Figure 6-15 with 
Ko = 6.0606. 


MATLAB Program 6-3 


num = (0. 0.1212 0.1600. 0.03879]; 

den = [T7 -1.20.52 0]; 
“k= 0:20; 

t= [0:2*k]: 

v= [0 20.0. 4]: 

axis(v); 

y = filter(num,den,r); 

plót(k,y,'o' Ky, k,0,2*k,'--") 

grid 

title((Unit-Ramp Response") 

xlabel('k') 

ylabel(‘y(k)') 


Thus, 
z — 1 (z — 1)(z? — 0.3212z + 0.03879) 0.2z 


lim e(k) ~ lim z z? — 1.22? + 0.52z (z -1y 
= 0.4485 


The steady-state error in following the unit-ramp input is 0.4485. (See Figure 6-17.) 
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Figure 6-17 Unit-ramp response of the control system shown in Figure 6-15 with 
Ko = 6.0606. 


6-7 SERVO SYSTEMS 


In the servo system it is generally required that the system have one or more 
integrators within the closed loop. (Unless the plant to be controlled has an integrat- 
ing property, it is necessary to add one or more integrators within the loop to 
eliminate steady-state error to step inputs.) 

One way to introduce an integrator in the mathematical model of a closed-loop 
system is to introduce a new state vector that integrates the difference between the 
command vector r and the output vector y. Figure 6-18 shows a possible block 
diagram configuration for a servo system with state feedback and integral control. 
The integral controller consists of m integrating elements, one for each command 
input component. (The command input is an m-vector and has m components.) The 
integrator can be included as part of the pole placement formulation that was 
presented in Section 6—5. 


Servo System With Integrator. Consider the servo system shown in Figure 
6-18. The plant is assumed to be completely state controllable and completely 
observable. Assume that the plant does not have an integrator. The plant state 
equation and output equation are 


x(k + 1) = Gx(k) + Hu(k) (6-175) 
y(k) = Cx(k) (6-176) 
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Figure 6-18 Servo system with state feedback and integral control. 


where 
x(k) = plant state vector (n-vector) 
u(k) = control vector (m-vector) 
y(k) = output vector (m-vector) 
G =n X n matrix 
H = n X m matrix 
C =m X n matrix 


(Note that in the present analysis we assume that the dimensions of the output vector 
and the control vector are the same; they are both m-vectors.) The integrator state 
equation is 


v(k) = v(k — 1) + r(k) — y(k) (6-177) 
where 
v(k) = actuating error vector (m-vector) 
r(k) = command input vector (m-vector) 
Equation (6-177) can be rewritten as follows: 
v(k + 1) = v(k) + r(k + 1) — y(k + 1) 
= v(k) + r(k + 1) — C[Gx(k) + Hu(k)] 
= —CGx(k) + v(k) — CHu(k) + r(k + 1) (6-178) 
The control vector u(k) is given by 
u(k) = ~K,x(k) + Kı v(k) (6-179) 


In our servo system the system configuration is specified in Figure 6-18. Our design 
parameters are matrices K, and K;. 
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In what follows we shall discuss the procedure for determining matrices K; and 
K; such that the system has the desired closed-loop poles. From Equations (6-175), 
(6-178), and (6-179), we obtain 
= (K: — K;G — K, CG)x(k) 
+ (In - KH — K,CH)u(k) + Kir(k + 1) (6-180) 
Noting that u(x) is a linear combination of state vectors x(k) and v(k), define a new 


state vector consisting of x(k) and u(k) [rather than x(k) and v(k)]. Then we obtain 
from Equations (6-175) and (6-180) the following state equation: 


hee) 


"Ix, - Kc- K;CG Ip- KH- K; cul 9 * MI +1) (6-181) 


The output equation, Equation (6-176), can be written as follows: 
- x(k) 
w = [co | (6-182) 


Note that the closed-loop poles of the system are determined by the system itself and 
do not depend on the command input r(k). The eigenvalues of the state matrix in 
Equation (6—181) determine the closed-loop poles of the system. 

To apply the pole placement technique of Section 6—5 directly to the design 
of the present servo system, consider the case where the command vector r(k) is a 
constant vector (step input) so that 


r(k) ^r 
Then Equation (6-181) becomes 


x(k + 1) 
he + il 
= Ix. - KG- K.CG I, - KH- K, eu| 23 t FA (6-183) 


Notice that, for the step input, x(k), u(k), and v(k) approach the constant vector 
values x(%), u(~), and v(«), respectively. Thus, from Equation (6-177), we obtain 
the following equation at steady state: 


v(%) = v(%) + r — y(~) 
Or 
y(~) =r 
There is no steady-state error in the output when the command input is a step vector. 
Also, at steady state Equation (6—183) becomes 


kal H I. - KG- K,CG p- KH- K; eu] a] * Ix (6-184) 
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Let us define the error vectors by 
x(k) = x(k) — x(*) 
u,(k) = u(k) — u(~) 
Then, subtracting Equation (6-184) from Equation (6-183), we obtain 


b : » : ls. - KG- OE doe K.H - K, eal S| (6-185) 


The dynamics of the system are determined by the eigenvalues of the state matrix 
appearing in Equation (6-185). Equation (6-185) can be modified to read 


kene ghehe ew 
where 


w(k) = [K - KG - K: CG i In - KH - K,cH] * | (6-187) 
u,(K) 


If we define 


(k) = bind = (n + m)-vector 


é-(§ O |= Ge + m) x (n + m) matris 
^ 0 . 
mh pun ue 
— m X (n * m) matrix (6-188) 
then Equations (6-186) and (6-187) become, respectively, 
Elk + 1) = G&(K) + Aw(k) (6-189) 
and 
w(k) = —Ké(k) (6-190) 
Notice that the controllability matrix for the system defined by Equation (6-189) is 
[R: GÉ: Gn A] = (n + m) x m(n + m) matrix 
In terms of G and H, this controllability matrix can be written as follows: 
"Eu EET 0:Hi GH! 1G Hic :(GU7 7H 
[H:GH:---:G fi] = Bii os eo te Oo (6-191) 


Since the plant state equation given by Equation (6-175) is assumed to be completely 
state controllable, the rank of the matrix 


[H: GH: ---:G""' HJ 
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is n. Hence, the rank of the matrix given by Equation (6-191) is n + m. Conse- 
quently, if the plant is completely state controllable, then the system defined by 
Equation (6—189) is completely state controllable and therefore the pole placement 
technique discussed in Section 6—5 applies to this case. 

Once the desired closed-loop poles are specified, matrix K can be determined 
by the pole placement technique. Using matrix K thus determined, we can obtain 
matrices K; and K, as follows. First, note that 


_ t 
IK] G-L za -[KG-K + K,CG!K,H+K,CH] (6-192) 


Then, from Equations (6-188) and (6-192), we have 
K = [K;G - K, + K;CG: -I„ + K;H + K, CH] 


= [K: Kill See ae + [02 En] 


Hence, we obtain 


iK] Sect ie] = Rog (6-193) 


The desired matrices K, and K, may be determined from Equation (6-193). 

It is noted that, when u(k) is an m-vector and m > 1, matrix K is not unique. 
Consequently, more than one set of matrices K; and K, can be determined. (Each 
possible K yields a set of matrices K, and K;.) In general, the set of K; and K, that 
gives the best overall system performance must be chosen. 

Finally, it is noted that, if not all state variables are measurable, then we need 
to substitute the observed-state variables for the unmeasurable state variables for 
state feedback purposes. (Also, if the measured state variables are contaminated by 
noises and therefore are not accurate, then we prefer to use the observed-state 
variables, rather than the actual state variables, for state feedback purposes.) Fig- 
ure 6-19 shows a block diagram for the servo system with state feedback where the 
Observed state is used in place of the actual state. 


Example 6-13 


Consider the digital control of a plant by use of state feedback and integral control. 
Assume that the system configuration is the same as that shown in Figure 6-18. Assume 
also that the pulse transfer function of the plant is 


Y(z) _ z7-0.5z? 
U(z 1-z'-001z ^ 0.122 ? 


where Y(z) and U(z) are the z transforms of the plant output y(k) and plant input 
(control signal) u(k), respectively. 

Determine an integral gain constant K; and a state feedback gain matrix K; such 
that the response to a unit-step command input is deadbeat. Assuming that not all state 
variables are available for direct measurement and using the system configuration 
shown in Figure 6-19 as an example for a block diagram of a system with a state 
Observer, design a state observer such that the observed state approaches the true state 
as fast as possible. 


(6-194) 
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State observer 


Figure 6—19 Servo system with observed-state feedback. 


We shall first obtain a state-space representation for the plant pulse transfer 
function. By comparing the given pulse transfer function with the standard form 


Y(z) E bo t biz | + bz? + bz? 
U(z) l*az'-taz^ctaz? 


we find 
bo = 0, bi = 0, b, = 1, b = 0.5 
a= —1, a= 0.01, 5 = 0.12 


Then, by referring to Equations (5-8) and (5-9), we can obtain the following state-space 
equations for the plant: 


x(k + 1) = Gx(k) + Hu(k) (6-195) 
y(k) = Cx(k) (6-196) 
where 
0 1 0 0 
G- 0 0 1}, H =! 0], C-[0.5 1 90] 
—0.12 -0.01 1 1 


Note that this plant is completely state controllable and completely observable. 


Determination of Integral Gain Constant K; and State Feedback Gain Matrix K; 
for Deadbeat Response. We shall now determine the integral gain constant K, and 
the state feedback gain matrix K;. In the present system we require the response to the 
step command input to be deadbeat. (Thus, we must place the closed-loop poles of the 
system at the origin.) 
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Referring to Equations (6-189) and (6-190), we have 


E(k + 1) = G&E(K) + Hw(k) 
w(k) = —Ké(k) 


where 

1 0:0 
a |GH|_| 0 0 110 
0j0 70.12 -001 1j1 
0 0 010 

0 

4 _ |0 

= o 

1 


Our problem here is to determine matrix K so that the closed-loop poles of the system 
are at the origin, or the desired characteristic equation is 


z*-z(ü 


By using the pole placement technique discussed in Section 6-5, matrix K can be 
determined easily. Referring to Ackermann's formula as given by Equation (6—71), we 


obtain 
K-[0 0 0 If: GÀ: G Ri G ÂJ o) 
where 
$(G) = 6 
Thus, 
0001 || o0 1 0 of 
" 00 1 1 0 0 1 0 
K-[0 0 0 Wo 1 1 os| |-012 -0.01 1 1 
1000 0 0 00 
0 0 0 1| -0.12 -013 099 1 
-jo 004 0.01 -1 1 0||-0.1188 -0.1299 0.86 0.99 
=I -1 1 0 O|| -0.1032 —0.1274 0.7301 0.86 
1 000] 0 0 0 0 
=[-0.12 -0.13 0.99 1] (6-197) 


Equation (6-197) gives the matrix K. 
The desired integral gain constant K, and the state feedback gain matrix K, are 
obtained from Equation (6-193). Noting that 


-1 1 010 
Sata] 0 -1 110 
CG TCH] |-012 -0.01 011 
0 Q5 110 


is nonsingular (to see this fact, use row operations and column operations and make 
the matrix a triangular matrix), we obtain 
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i =T : G-L: H D 
[K;: Ki] = [K + oiu] CG | A 
-1 1 010] 
= A 0 1 110 
=[-0.12 -0.13 0.99:2] -0.12 -0.01 0/1 
0 0.5 1:0 
-1 -4 01k 
Eddy e s| 9 à 01d 
= [-0.12 -—0.13 0.99:2] 0 1 Old 
-—Qi2 ee 1:95 
=[-0.12 0.3233 2:0.6667] (6-198) 
From Equation (6-198) we obtain the integral gain constant K;: 
K, = 0.6667 = 2 (6-199) 
The state feedback gain matrix K, is given by 
K, = [-0.12 0.3233 2] (6-200) 


Determining Output y(k). Next, let us determine the output y(k). From Equa- 
tion (6-196) we have 
x(k) 
y(k) = Cx(k) = [0.5 1 0]|xx(K) 
x(k) 


To obtain output y(k), we shall first determine the state vector x(k) and signal v(k). 
From Figure 6-18, we have 


x(k + 1) = Gx(k) + Hu(k) (6-201) 
y(k) = Cx(k) (6-202) 
v(k) = v(k — 1) + r(k) — y(k) (6-203) 
u(k) = —K2.x(k) + Kiv(k) (6-204) 


Hence, from Equations (6-201) and (6-204) we obtain 
x(k + 1) = Gx(k) + Hu(k) 
= (G — HK.)x(k) + HK, v(k) (6-205) 
Also, from Equations (6-202), (6-203), and (6-205) we get 
v(k + 1) = v(k) + r(k * 1) — y(k * 1) 
= v(k) + r(k + 1) - Cx(k + 1) 
= v(k) + r(k + 1) — C[(G — HK2)x(k) + HKiv(k)] 
= —(CG - CHK,)x(k) + (1 — CHK,)v(k) + r(k + 1) (6-206) 
Combining Equation (6-205) and (6-206), we get 
ee s ET cR MEI + Bz +1 (620) 
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which can be rewritten as 
x(k + 1) 0 1 O Off x(k) 0 
x(k*1| |0 0 1 OF x2{k) 0 
x(k+1)]~lo -1 -1 allxsay]Tfof&*+D (6-208) 
v(k + 1) 0 —1 -1 1| v(k) 1 
Since the command input r(k) is a unit-step input, we have 
r(k) = 1, k =0,1,2,... 
Let us assume that the initial state is 
x,(0) a 
xX«0)| _ | b 
x3(0) c 
v(0) d 
where a, b, c, and d are arbitrary. Then, from Equation (6—208), we have 
x(1) 0 1 O0 0j[a 0 b 
x(1)|] |0 0 1 0|b d ME. c 
x3(1) 0 -4 -1 2ile 0 -ib-ct2d 
v(1) 0 —-1 -1 ijid 1 -lb-ct+d+l 
Similarly, 
x,(2) [4 
x2(2) = —4b =¢ +3 
x3(2) 3 
v(2) -ib -ic +łd+2 
x(3) -ib —-c- id 
x2(3) | _ $ 
xa(3) E 
v(3) 1 
and 
x(k) $ 
xXk)| _ | 3 4 
xa(k) i, k = 4,5,6,... 
v(k) 3 
The output y(k) is obtained as follows: 
xiY(0) a 
y(0 -[05 1 Off x(0)| = [0.5 1 O]b|-—1a-*b 
xs(0) c 
Similarly, 
yQl) =4b+e 


y(2) = -b - 4c + 3d 
yG) = -4b - jc & 4d +} 
yk)21, k=4,5,6,... 
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Notice that 


u(k) = —-Kax(k)  Kiv(k) 
2 
= -[-0.12 0.3233 2]|i | + @@ = 0.08670 
$ 
where k = 4,5,6,.... Since u(t) for t = 4T (where T is the sampling period) is 


constant, there is no intersampling oscillation in the output. Thus, the response of the 
system is deadbeat. 

Note that the output y(k) reaches unity in at most four sampling periods and will 
stay there in the absence of disturbances or new command inputs. [See, for example, 
the sample unit-step response sequence shown in Figure 6—20(a).] Under special initial 
conditions, for example, a = b = c = 0 and d = 1, the output reaches unity in three 
sampling periods and stays there, or y(k) = 1 fork = 3,4,5,... [see Figure 6-20(b)]. 


Design of the State Observer. Next, we shall design a state observer for the 
system. Since the plant output y(k) is measurable, let us design a minimum-order 


x, (0) 1 

x2 (0) |_| -0.5 

X3 (0) F 0 
v(0) 1 


y(k) = 0.5x,(k) + x? (Kk) 


(a) 


yik) = 0.5x, (k) + x5 (K) 


(b) 


Figure 6-20 Sample unit-step response sequences for the servo system with actual- 
(measured-) state feedback and integral control designed in Example 6-13. 
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Observer. Let us assume that we desire the deadbeat response. In the present system, 
output matrix C is given by 


C-[05 1 0] 


To change the output matrix C from [0.5 1 0O]to[1 0 OJ], let us make the following 
transformation: 


x(k) = T&(k) (6-209) 
where 
00 1 
T=/1 0 -05 (6-210) 
01 0 
Note that 
05 1 0 
T'=/0 01 (6-211) 
1 00 
Then the plant state equations become 
Ek + 1) = T'GT£(K) + T ! Hu(k) (6-212) 
y(k) = CTE(k) (6-213) 
where 
05 10] 0 1 ojo 0 1 
T'GT-|0 01 0 0 1|1 0 -0.5 
1 0 0|-012 -001 110 1 0 
0.5 1 -0.25 g 
=] —0.01 1 -0115|2-G 
1 0 -0.5 
0.5 1 O} 0 0 7 
T'H=|0 0 1|[0|-|1|-H 
1 0 OF 1 0 
00 1 . 
CT-[05 1 0]1 0 -o5|-[1 0 OJ=C 
01 0 
The transformed system equations are as follows: 
$k +1)] | 05;1 -025 l'át)] [9 
é&k*1)-2/|-001!1 -0.115|| (KR) | + | 1 luk) (6-214) 
&(k + 1) 1:10 -0.5 &(k) 0 
Silk) 
y(k) = [1:0 0]| &(k) (6-215) 
&(k) 


Since only one state variable can be measured, we need to observe two state variables. 
Hence, the order of the minimum-order observer is 2. From Equations (6-138) and 
(6—214), we have 


Sec. 6-7 Servo Systems 471 


Gop — Ke Gas = i ar - HE: —0.25] 
A 
| |]1-k, -0.115 + 0.25k,, 
=ke | —0.5 + 0.25ke, 


The observer characteristic equation is 


z-1tk, 0.115 — 0.25k., 
kes z + 0.5 — 0.25k,, 


=(z-1+k.,)(z + 0.5 — 0.25ke,) — k.(0.115 ~ 0.25k.,) 

= 27 + (ke, — 0.25k., — 0.5)z + (0.5k,, + 0.135k., — 0.5) 

=0 (6-216) 
Since we desire the deadbeat response, the desired characteristic equation is 


z=0 


|zI = Gos + K. Gas| = 


Hence, we require 
ke, — 0.25k., — 0.5 = 0 
0.5k,, + 0.135k., — 0.5 = 0 


Solving these two simultaneous equations for k., and k.,, we obtain 
_ | ke | _ | 0.7404 
E a j hus (ed) 

Integral Control with State Observer. We have thus considered a design prob- 
lem in which the observed state variables are fed back in a minor loop and an integral 
controller is used in the main loop. 

In the pole placement part of the design, we used the actual state rather than the 
observed state. In what follows we shall obtain the system equations for the case where 
the integral controller and the state observer are used. 


The use of the observed state x(k), where X(k) = TË(k), in the state feedback 
control modifies the control signal u(k) as follows. From Equation (6-204) we have 


u(k) = —K,&(k) + Kiv(k) = —K; TÉ(k) + Kiv(k) (6-218) 
Define 
Elk) — E(k) = e(k) 
Then Equation (6-218) can be written as follows: 
u(k) = —K.T&(k) + Kiv(k) + K2Te(k) (6-219) 


which can be rewritten as 


&(k) 
u(k) = [70.3233 -2 0.2817]| &(k) 
&(k) 
e(k) 
+ Zv(k) + [0.3233 2 -—0.2817]| e(Kk) (6-220) 


ex(k) 
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By substituting Equation (6—220) into Equation (6-214), we obtain 


&(k + 1) 0.5 1 —0.25 || &(k) 
&lk *c1|-|-3 -1 i &(k) 
&(k + 1) 1 0 -0.5 || &(k) 
0 0 0 0 elk) 
+ | 34 [v(k) + | 0.3233 2 —0.2817 || eK) (6-221) 
0 0 0 0 ek) 


Also, Equation (6—206) can be modified to read 


v(k + 1) = -(CGT — CHK, T)&(k) + (1 - CHK,)v(k) + r(k + 1) 
or 


&(k) 
v(k +1) = -[0.5 1 -025] &(k) | + v(k) + r(k + 1) (6-222) 
&(k) 


Referring to Equation (6-156) and noting that ei(k) = 0, we can give the observer 


error dynamics by 
eXk + 1) _ th A ek) 
prn + 3] "isses eS prol 


Therefore, 
ek*1| fii 0 .— 0 We e(k) 
elk +1)}=|0! 02596 0.0701 || eX) (6-223) 
ek + 1) 01-—0.9615  —0.2596 || ek) 


Combining Equations (6—221), (6-222), and (6—223) into one state equation, we obtain 


&(k + 1) 05 1 -025 0 0 0 0 &(k) 
&(k + 1) -) -1 | % 023 2 —0.2817 || &(k) 
&(k +1) 1 0 -05 00 0 0 &(k) 
vk-1)|2|-05 -1 025 1 0 0 0 v(k) 
elk + 1) 0 0 0 01 0 0 a(k) 
elk + 1) 0 0 0 00 0.2596 — 0.0701 || ek) 
elk + 1) 0 0 0 00 —0.9615 —0.2596 || ek) 

0 

0 

0 

+11 |r(k + 1) (6-224) 

0 

0 

0 


The plant output y(k) can be given by 
&(k) 
yk)-[ 0 0] an = &(k) (6-225) 
3 


It can be shown that for the unit-step command input, the response of the system 
under an arbitrary initial condition, 
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&(0) 
£(0) 
&(0) 
v(0) | = 
€,(0) 
eX(0) 
ex(0) 


requires at most six sampling periods to complete. (That is, the output reaches unity 
in at most six sampling periods and thereafter it will stay there in the absence of 
disturbances and new command inputs.) 

Notice that, as we have seen earlier, if the actual state can be fed back, the system 
requires at most four sampling periods to complete the unit-step response. [The system 
requires only three sampling periods to complete the unit-step response if £(0) = 0, 
&(0) = 0, &(0) = 0, and v(0) = 1.] However, if the state observer is used, the response 
time increases. If the minimum-order observer (second-order observer, in the present 
case) is used, then the system requires at most six sampling periods to complete the 
unit-step response. [See, for example, the sample unit-step response sequence shown 
in Figure 6—21(a).] This means that in special cases the response time is much shorter. 


WR ono TA 


y(k) 
£, (0) 0 
1.5 £,(0)} 10 
£,(0}| jo 
v(Q) |=| 1 
19 e,(0)| |o 
€,(0) | | 0.5 
5E e,(0) | |0 
y(k) = t (k) 
0 
(a) 
(Kk) 
i &,()] [o 
£, (0) 0 
"S &0 | lo 
v(o) |=| 1 
0.5 «(0| |0 
e; (0) 0 
e0) | [0 
0 
yik) = & (k) 


(b) 


Figure 6-21 Sample unit-step response sequences for the servo system with 
observed-state feedback and integral control designed in Example 6-13. 
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For example, if the initial conditions are &(0) = 0, &(0) = 0, &(0) = 0, v(0) = 1, 
€X(0) = 0, and &(0) = 0, then the system requires only three sampling periods to 
complete the unit-step response. See Figure 6—21(b). 


EXAMPLE PROBLEMS AND SOLUTIONS 


Problem A-6-1 


The definition of controllability given in Section 6-2 is not the only one used in the 
literature. Sometimes the following definition is used: A control system is defined to 
be state controllable if, given an arbitrary initial state x(0), it is possible to bring the 
state to the origin of the state space in a finite time interval, provided the control vector 
is unconstrained (unbounded). 

The concept of reachability, similar to the concept of controllability, is available 
in the literature and is used in the following way: A control system is defined to be 
reachable if, starting from the origin of the state space, the state can be brought to an 
arbitrary point in the state space in a finite time period, provided the control vector is 
unconstrained. 

Show that the system 


2 :3]- [1 ES) [ipe 
is controllable (in the sense defined in this problem), but is not reachable. 
Solution Rewriting the system state equation, we obtain 
xi(k +1) 20 
x(k + 1) = —xu(Kk) + xk) + u(k) 
Starting from an arbitrary initial state, we have 
x(1) = 0 
xX1) = —xi(0) + x2(0) + u(0) 
Hence, by choosing 
u(0) = x,(0) — x2(0) 


the state can be brought to the origin in one step. Thus, the system is controllable in 
the sense defined in this problem. 
If the state starts from the origin, we have 


xi(1) =0 
x2(1) = —x,(0) + x2(0) + u(0) = —0 + 0 + u(0) = u(0) 
Although x;(1) can be brought to an arbitrary point in one step, x;(1) cannot be 
controlled. Consequently, the system is not reachable. 
Notice that the present system is not controllable in the sense defined in Sec- 
tion 6-2 (where the final state is an arbitrary point in the state space including the 
origin), because the required rank condition is not satisfied, as the following shows: 


rank [HGH] = rank | |=1<2 


1 1 
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As seen in this problem, controllability and reachability (both defined in this 
problem) are different. However, if the state matrix G is nonsingular, then complete 
state controllability in the sense defined in this problem and complete state reachability 
mean the same thing. That is, for the system with a nonsingular matrix G, complete state 
controllability means complete reachability, and vice versa. 


Problem A-6-2 
Consider the completely state controllable system defined by 
x(k + 1) = Gx(k) + Hu(k) 


where 


0 0.3679 0.6321 


The sampling period is 1 sec. If the control signal u(k) is unbounded, or 


G= E on H- Ea 


—9 x u(k) so 


then an arbitrary initial state x(0) can be brought to the origin in at most two sampling 
periods by using a piecewise-constant control signal. 

Derive the control law to transfer an arbitrary initial state x(0) to the origin. 
Determine the region in the state space in which the initial state can be brought to the 
origin in one sampling period. 

If the magnitude of u(k) is bounded, then some initial state cannot be transferred 
to the origin in two sampling periods. (Three, four, or more sampling periods may be 
required.) Suppose that 


lu(k)| s 1 
Determine the region of the initial states in the x, x2 plane that can be transferred to 
the origin in one sampling period and two sampling periods, respectively, by using the 
bounded control signal |u(k)| = 1. 


Solution 


For the case where u(k) is unbounded. Since the system is of the second order, we need 
at most two sampling periods to transfer any initial state x(0) to the origin. Noting that 


x(1) = Gx(0) + Hu(0) (6-226) 
x(2) = 0 = Gx(1) + Hu(1) = G’x(0) + GHu(0) + Hu(1) 


and G is nonsingular, we obtain 


x(0) = -G-'Hu(0) - G~? Hu(1) (6-227) 
Substituting Equation (6-227) into Equation (6-226), we get 
x(1) = —G"'Hu(1) (6-228) 
Noting that 
GH- E "Xn | osa] - Ben 
0 2.7181 |} 0.6321 1.7181 


1 —6.3881 || 0.3679 | _ | —3.6700 
O0 7.3881 || 0.6321 4.6700 
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we obtain from Equations (6-227) and (6-228) the following two equations: 
[:9]--mme-[impe e% 
[8] o ene 
Combining Equations (6—229) and (6-230), we have 


Be i) «| 0.7181 so | a «| 


x0) x2(1)| [1.7184] -4.6700|| u() 0 


which can be modified to 


(0) (1| |-1.5820 —-1.2433| x0) xi(1) 
Be “0 Hl 0.5820 PAB 20] (6-231) 


from which we obtain 
u(k) = —1.5820xi(k) — 1.2433x2(k), k=0,1 


This equation gives the required control law. With this control law, any initial state x(0) 
can be transferred to the origin in at most two sampling periods. 

Let us next find the initial states from which the system state can be transferred 
to the origin in one sampling period. By equating x(1) with 0 in Equation (6-226), we 
obtain 


x(1) = 0 = Gx(0) + Hu(0) 
from which we get 
x(0) = -G~ Hu(0) 


x(0)| | 0.7181 
[o] = [07 ko (6-232) 
From Equation (6-232), we find that if the initial state lies on the line 


1.7181x,(0) + 0.7181x.(0) = 0 


then it can be transferred to the origin in one sampling period. (Otherwise, we require 
two sampling periods to bring the initial state to the origin.) 


or 


For the case where u(k) is bounded, or |u(k)| = 1. If we require x(1) = 0, then from 
Equation (6-232) we have 


x:(0) = 0.7181u(0), — x;(0) = —1.7181u(0) 
Since |u(0)| = 1, we obtain 
|x,(0)| = 0.7181, jx2(0)| s 1.7181 
Hence, if the initial state lies on the line segment 
1.7181x,(0) + 0.7181x;(0) = 0, —0.7181 = x,(0) = 0.7181 


it can be brought to the origin in one sampling period. This line segment is shown in 
Figure 6-22 as line AOB. 
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Region for 
two sampling 


periods Region (line) for 


one sampling 


Figure 6—22 Regions from which initial states can be brought to the origin in one 
or two sampling periods when u(k) is bounded so that |u(k)| = 1. 


If we require x(2) = 0, then from Equation (6—231) we obtain 
u(0) = —1.5820x,(0) — 1.2433x2(0) 
u(1) = 0.5820x,(0) + 0.2433x2(0) 
Since |u(0)| = 1 and |u(1)| = 1, we obtain the following four relationships: 

1.5820x,(0) + 1.2433x.(0) = 1 
1.5820x1(0) + 1.2433x4(0) = -1 
0.5820x1(0) + 0.2433x2(0) = 1 
0.5820x,(0) + 0.2433x4(0) = —1 


The region bounded by these four inequalities is shown in Figure 6-22. If the initial state 
lies in this region, except on line AOB, then it can be transferred to the origin in two 
sampling periods. If the initial state lies outside this region, then it will take more than 
two sampling periods to bring the state to the origin. 
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Problem A-6—-3 
Consider the following pulse-transfer-function system: 
Y(z _ _z (1 + 0.8271) 
U(z 1+ 1.327! + 0.477? 
A state-space representation for this system can be given by 


Bes : D] E EA ES Bes] t Hz (6-233) 
WSs A (6-234) 
A different state-space representation for the same system can be given by 
Be : a = E eae) ù Az (6-235) 
y(k) = [0 i 29 ear 


Show that the state-space representation defined by Equations (6-233) and 
(6-234) gives a system which is state controllable but not observable. Show, on the other 
hand, that the state-space representation defined by Equations (6-235) and (6-236) 
gives a system that is not completely state controllable but is observable. Explain what 
causes the apparent difference in the controllability and observability of the same 
system. 


Solution Consider the discrete-time control system defined by Equations (6-233) and 
(6-234). The rank of the controllability matrix 


womf? 1. 


is 2. Hence, the system is completely state controllable. The rank of the observability 
matrix 
; _ {0.8 —0.4 
[C* : G*C*] = k | 


is 1. Hence, the system is not observable. 
Next, consider the system defined by Equations (6-235) and (6-236). The rank 
of the controllability matrix 


1 -0.5 
is 1. Hence, the system is not completely state controllable. The rank of the observabil- 


ity matrix 
cien = [1 ; | 


[H: GH) = ee EM 


1 -13 
is 2. Hence, the system is observable. 

The apparent difference in the controllability and observability of the same 
system is caused by the fact that the original system has a pole~zero cancellation in the 
pulse transfer function: 

Y() _ z t 0.8 _ z t 0.8 
U(z) z +1.32 +04 (z +0.8\(z + 0.5) 
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If a pole—zero cancellation occurs in the pulse transfer function, then the controllability 
and observability vary, depending on how the state variables are chosen. 

Note that to be completely state controllable and completely observable the 
pulse-transfer-function system must not have any pole-zero cancellation. 


Problem A-6-—4 
Consider the control system defined by 
x(k + 1) = Gx(k) + Hu(k) (6-237) 
y(k) = Cx(k) + D (6-238) 
where 
x(k) = state vector (n-vector) 
u(k) = control signal (scalar) 
y(k) = output signal (scalar) 
G =n X n matrix 
H = n x 1 matrix 
C = 1 x n matrix 
D = scalar (constant) 
As stated by Equation (5-60), the pulse transfer function F(z) can be given as follows: 
F(z) = CGI - QH + D 


Prove that, if the system is completely state controllable and completely observable, 
then there is no pole-zero cancellation in the pulse transfer function F(z). 


Solution Suppose that there is a pole-zero cancellation in the pulse transfer function, 


even though the system is completely state controllable and completely observable. 
Consider the following identity equation: 


I 09|z:1-G H|_[zI-G m 
C(z21-G)! 1| -C D 0 F(z) 
Taking the determinant of the left-hand side of the equation and equating it with the 
determinant of the right-hand side, we obtain 


I-G H 
_ p| = EI - GIF@) 


or 
" -G H 
-C D 


F(z) =a- o] 


The poles of F(z) are the roots of [zI — G| = 0, and the zeros of F(z) are the roots of 


mos H 


-c p^? (6-239) 


Now suppose that a pole-zero cancellation occurs. Let us assume that z = z, is a pole 
of F(z) and is also a zero of F(z), so cancellation occurs. Then z = zi is a root of 
|zI — G| = 0. Also, it is a root of the determinant equation given by Equation (6-239). 
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This means that there exists a vector 


where v is an n-vector and w is a scalar, such that 


Peak e 


If w + 0, then from Equation (6-240) we have 
(I - Gv + Hw = 0 
or 
(G — zi Dv = Hw (6-241) 


Since z = z; is a root of the characteristic equation, the characteristic polynomial 
¢(z) of G can be written as follows: 


(z) = (z - 21) b(z) 
or 
$(G) = (G - 2:1) d(G) = AGG - 21) =0 
From Equation (6-241) we have 
$(G)v = $(G)(G - z: Iv = é(G)Hw = 0 
Hence, 
é(G)H = 0 


Since $(z) is a polynomial of degree n — 1, the fact that 6(G)H = 0 means that vector 
G"^'! H can be written in terms of H, GH,...,G" 7 H. Hence, 


This contradicts the assumption that the system is completely state controllable. Thus, 
if the system is completely state controllable, then there is no pole-zero cancellation 
in the pulse transfer function. 

Next, referring to Equation (6-240), if w = 0 and v # 0, then we have 


(z1 - G) =0 (6-242) 
Cv=0 (6-243) 

From Equation (6-243) we have 
v*C* = 0 (6-244) 


From Equation (6-242) we obtain 
v*G* = z, v* 
Hence, 
v*G*C* = z, v*C* = 0 
where we have used Equation (6-244). Similarly, 


v*(G*)? C* = v*G*G*C* = z, v*G*C* = z?y*C* = 0 


2 Ame 
| i 
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and 
v*(G*)*"'C# = zi v*C*-0, & = 1,2,3,...,n 
Hence, 
v*[C* :G*C* :---:(G9)"! Ct] = 0 
or 


This contradicts the assumption that the system is completely observable. Thus, there 
is no pole~zero cancellation if the system is completely observable. 

This completes the proof that if the system is completely state controllable and 
completely observable then there is no pole-zero cancellation in the pulse transfer 
function F(z). 

Problem A-6-5 
Consider the completely state controllable system 
x(k + 1) = Gx(k) + Hu(k) 


Define the controllability matrix as M: 


Show that 
00 >- 0 -a, 
10.0 -a4 
M'GM=|0 1 --- 0 -a,5 (6-245) 
00- 1 -a 
where a1, a2, . .., à, are the coefficients of the characteristic polynomial 


zI — G| = 2” + az"! +++ + a,1z + ay 


Solution Let us consider the case where n = 3. We shall show that 


0 0 — (3 
GM-M 1 0 -a (6-246) 
0 1 —ü:i 


The left-hand side of Equation (6—246) is 
GM = G[H: GH: G?H] = [GH : G? H: G? H] 
The right-hand side of Equation (6—246) is 


0 0 —43 
[H:GH:G?H]}1 0 -a | = [GH: GH: -aH - 2, GH - a, G^H] (6-247) 
0 1 ~A 


The Cayley-Hamilton theorem states that matrix G satisfies its own characteristic 
equation, or 
G” + aG + -e + anG 
For n = 3, we have 
G-aGtoGctal-0 (6—248) 
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Using Equation (6-248), the third column of the right-hand side of Equation (6-247) 
becomes 

—a;H — a,GH — a,G'H = GH 
Thus, Equation (6-247), the right-hand side of Equation (6-246), becomes 


0 0 —ü5 
[H:GH:G'H] 1 0 -a |= (GH!G?H:G°H] 
0 1 =á 
Hence, we have shown that Equation (6-246) is true. thus, 
0 0 mi 
M'GM-^|1 0 -a 
0 1 —üi 
The preceding derivation can easily be extended to the general case of any positive 
integer n. 
Problem A-6-6 


Consider the completely state controllable system 
x(k + 1) = Gx(k) + Hu(k) 


Define 
M = [H: GH: -- -:G"'H] 
and 
An-1 4-2 ay 1 
Q@n-2 An-3 1 0 
w=| i: 
a, 1 0 0 
1 0 0 0 


where the a;'s are coefficients of the characteristic polynomial 


zI- G| = z” + az"! +--+ anız +a, 


Define also 
T = MW 
Show that 
0 1 0 0 0 
0 0 1 e 0 0 
T'GT-| : : : : |, T'H-|: 
0 0 0 e] 0 
—ü, -ânı 74-2 cc] 7d 1 
Solution Let us consider the case where n = 3. We shall show that 
0 1 0 
T 'GT = (MW)"'G(MW) =| 0 0 1 (6-249) 
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Referring to Problem A-6—5, we have 


0 0 —43; 
(MW)'G(MW) = W'(M'GM)W-W|1 0 -a |W 
0 1 Ta 
Hence, Equation (6-249) can be rewritten as follows: 
0 0 -a 0 1 0 
wii 0 -a4/W- 0 0 1 
0 1 —41 —ü3 ~a2 —, 
Consequently, we need to show that 
0 0 -a 0 1 0 
10 -a|W=W 0 0 1 (6-250) 
0 1 —64 —5 —2 ~a 
The left-hand side of Equation (6—250) is 
0 0 -a|[a a 1 -a; 0 
10 -a|« 1 0210 a 1 
0 1 -aj1 0 0 0 1 0 
The right-hand side of Equation (6—250) is 
a a, 1 0 1 0 —-a, 0 0 
ay 1 0 0 0 1 = 0 ay 1 
1 0 0 —ü, —-a, —-aQ, 0 1 0 
Clearly, Equation (6-250) holds true. Thus, we have shown that 
0 1 0 
T'GT-| 0 0 1 
—ü3 —45 -a 
Next, we shall show that 
0 
T'H- |0 (6-251) 
1 
Note that Equation (6-251) can be written as follows: 
0 0 
H = T| 0| = MW 0 
1 1 
This last equation can easily be verified, since 
0 0 à a 11/0 
T| 0| = MW| 0 | = [H:GH:G’H]ia, 1 O0]||O 
1 1 1 0 Of, 1 
1 


= [H:GH:G'H]| 0 = H 
0 
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Hence, 
0 
T'H-|0 
1 
The derivation shown here can easily be extended to the general case of any positive 
integer n. 
Problem A-6—7 


Consider the following system: 
x(k + 1) = Gx(k) + Hu(k) 


where 
0 1 0 0 
G=] 0 0 1 |, H^2|0 
—a3 ~-@2 — 1 


Notice that the system is in the controllable canonical form. 
Define the transformation matrix T as follows: 


T = MW 
where 
M = [H: GH: G° H] 
and 
4 a, 1 
W=ja 1 0 
1 0 0 


Show that if the system is in the controllable canonical form then T = I. Consequently, 
if the system is in the controllable canonical form, then 


a a 1 
M'-W-|a 1 0 
1 0 0 
Solution Since 
0 0 1 
M = 0 1 —-a, 
1 —-à1 —atd 
we have 
0 0 1 a à 1 100 
T-MW-|0 1 —üi a 1 0|[-5|0 1 O0O|-I 
1 —ü| ~a + a 1 0 0 0 0 1 
Hence, 
2 ay 1 
M! =W= ay 0 
0 
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Problem A-6-8 
Consider the completely observable system 
x(k + 1) = Gx(k) 
y(k) = Cx(k) 


Define the observability matrix as N: 


Show that 
0 1 0 0 
0 0 1 e 0 
N*G(N* t=] : : : : (6-252) 
0 0 0 68] 
Tan —ü,y-1 —7ün-2 ^'' TQ 
where 41,22, ..., à, are the coefficients of the characteristic polynomial 


zI — G| = z” + az"! +--+ + an-z + an 
Solution Let us consider the case where n = 3. Then Equation (6-252) can be 
written as 
0 1 
N*G(N*''-| 0 0 1 (6-253) 
Equation (6-253) may be rewritten as 


N*G =| 0 0 1 |N* (6-254) 


We shall show that Equation (6-254) holds true. The left-hand side of Equation 


(6-254) is 
c CG 
N*G = | CG |G = | CG? 
CG? cc? 


The right-hand side of Equation (6—254) is 


0 1 0 0 1 0 C CG 
0 0 1 [N*-| 0 0 1 CG |= CG? 
—ü3 “aà —4i —03 —-az —, CG? —-a,C — a2 CG - ay CG’ 


The Cayley-Hamilton theorem states that matrix G satisfies its own characteristic 
equation, or, for the case of n = 3, 


G+aG+aGt+al=0 
Hence, 


—a,CG* —- a CG — aC = CG? 
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Consequently, 
0 1 0 CG 
0 0 1 IN* =| CG? 
—a3 ~a —-a, CG? 
Thus, we have shown that Equation (6-254) holds true. Hence, 
0 1 0 


N*G(N"-|0 0 1 
~az ~a —a, 


The derivation presented here can be extended to the general case of any positive 


integer n. 
Problem A-6-9 
Consider the completely state controllable and completely observable system given by 
x(k + 1) = Gx(k) + Hu(k) (6-255) 
y(k) = Cx(k) + Du(k) (6-256) 
Define 
N = [C*:G*C* :-..: (G^! c*] 
and 
dni an-2 ° 0 1 
an-2 ân-3 c: 1 0 
We! : : E 
a 1 : 00 
1 0 >. 00 


where the a;'s are coefficients of the characteristic polynomial 


lzI-Gl = z” + az" + +- + an-z + a 


Define also 
Q = (WN*)™ 
Show that 
00: 0 -a, 
1 0 ++ 0 -a4 
Q'GQ-|0 1 -> 0 -anz 
Ü Ure 1i -a 
CQ-[0 0 -> O 1] 
b, — a, bo 
Q"H = b. - Gn - 1 bo 


bi-ai bs 


where the b,’s (k = 0,1,2,...,m) are those coefficients appearing in the numerator 
of the pulse transfer function when C(zI — G) ! H + D is written as follows: 
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n n-l ene 
C(zI - G)*H +D E boz + bız + + bn- z tb, 


z” + az ts cta. az, 
where D = bo. 
Solution Let us consider the case where n = 3. We shall show that 
0 0 —35 
Q` GQ = (WN9G(WN*)'-|1 0 -a (6-257) 
0 1 —ü|i 
Note that, by referring to Problem A-6-8, we have 
0 1 0 
(WN*)G(WN*)'! = WIN*G(N) W^ = W| 0 0 1 W7 


Hence, we need to show that 


0 1 0 0 0 -a 
W| 0 0 1[w'-2[|1 0 ~a 
—d3 ~a: —üi 0 1 —ay 
or 
0 1 0 0 0 -a 
w 0 0 1 |=]1 0 -a |W (6-258) 
~az “a: —a, 0 1 7a, 
The left-hand side of Equation (6-258) is 
0 1 0 5; a 1 0 1 0 —(t3 0 0 
wl 0 0 1 }=ja 1 Of; 0 0 1 |=| 0 a1 
—~a3 —ü»2 —-a 1 0 0 —(53 —-a ~A 0 1 0 
The right-hand side of Equation (6-258) is 
0.0 —d3 0 0 —03 52 ay 1 —a3 0 0 
10 -ajJW=|1 0 -ajja 1 0/10 a 1 
0 1 -a 01 -a|[1 0 0 0 1 0 
Thus, Equation (6—258) holds true. Hence, we have shown that Equation (6—257) holds 
true. 
Next, we shall show that 
CQ-[0 0 1] 
or 
C(WN*"'-[0 0 1] (6-259) 
Notice that 
a a 1 C C 
[0 O 1(WN [0 0 1a 1 0j CG|-[1 0 0] CG .-C 
1 0 0|| CG CG 


Hence, we have shown that 
[0 0 1] = C(WN'! 
which is Equation (6-259). 
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Next, define 
x-QX 
Then Equation (6—255) becomes 
K(k + 1) = Q" GQ&(K) + Q" Hu(k) (6-260) 
and Equation (6-256) becomes 
y(k) = CQ&(k) + Du(k) (6-261) 
For the case of n = 3, Equation (6-260) becomes as follows: 
0 0 “a3 ys 
X(k*1)-|1 0 -ajil&(k) * | y; |u(k) 
0 1 —|i Yı 
where 
ys 
z| = QH 
Yı 


The pulse transfer function F(z) for the system defined by Equations (6-260) and 
(6-261) is 


F(z) = (COGI - Q GQ) QH + D 


Noting that 
CQ-[0 0 jj 
we have 
z 0 a |' ys 
F(z)-[0 0 1i] -1 z az |+ D 
0 -1 z+aq yı 
Note that D = bo. Since 
z 0 a | 1 z?^taz-ta Q5 —àsz 


we have 


1 


ys 
-—————————[zz +D 
Drar taz? al l| » 


Yı 


F(z) = 


| nztypzt ys 
z taz + az +a 
E boz? t (yı + a, boz? + (v2 t az bo)z t (v; T az bo) 
z + az? + az +a 
_ boz? + biz? + bız + bs 
zrazctazcta 


+ bo 


Hence, y; = bı — ai bo, y; = b; — a; bo, and y; = b3 — a, bo. Thus, we have shown that 
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ys bs — as bo 
Q'"H =] y2 |= | b2 — azbo 
Yı bı — abo 
Note that what we have derived here can easily be extended to the case where n is any 
positive integer. 
Problem A-6-10 
Consider the system defined by 
z+1 
z? +z +0.16 


Referring to Section 6—4, obtain state-space representations for this system in the 
following three different forms: 


G(z) = (6-262) 


1. Controllable canonical form 
2. Observable canonical form 
3. Diagonal canonical form 


Solution 


1. Controllable canonical form. By comparing Equation (6-262) with Equation 
(6-39), we obtain 


a 7 1, a = 0.16, bo = 0, b, = 1, b,=1 
Hence, referring to Equations (6-37) and (6-38), we obtain 


k+] [o afew] [o 
peil- o aeg] [ko 
y(k) = [1 1 20 | 


2. Observable canonical form. Since a, = 1, à; = 0.16, bo = 0, b; = 1, and b; = 1, 
referring to Equations (6-41) and (6-42), we obtain 


(k+1)]_[o -016]| x0] , [1 
iz 2]-[2 3 28) +[ deo 
y(k) = [0 1 2] 


3. Diagonal canonical form. Notice that 
—1 
3 3 
z+02 z* 08 
By comparing this last equation with Equation (6—47), we obtain 


a Bi =$, œk = —4, pr=—0.2, p= —0.8, D=0 


G(z) = 


Hence, by arbitrarily choosing a, = o; = 1 and referring to Equations (6-45) and 
(6-46), we obtain 


0] [-02 0 [aw], fi 
eased oa 200 iko 


y(k) = li SEA 
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Problem A-6--11 


Consider the double-integrator system 


x((k + 1)T) = Gx(kT) + Hu(kT) 


pal of [TR 
e-f i} Ul 
and where T is the sampling period. (See Problem A—5-16 for the derivation of this 
discrete-time state equation for the double integrator system.) Determine a state 


feedback gain matrix K such that the response to an arbitrary initial condition is 
deadbeat. For the initial state 
.|1 
x(0) = H 


determine u(0) and u(T) for T = 0.1 sec, T = 1 sec, and T = 10 sec. 
Solution Let us define 


where 


K= [kı ka] 
Then 
2 2 
2-140, -T+ Ok, 
lel - G + HK] = Tk, z-1+ Thk 
2 2 
= 2-(2- T re 22 +1 «Tu =, Tk; 
=0 (6-263) 
The desired characteristic equation is 
z-20 (6-264) 


Hence, by comparing Equations (6-263) and (6-264), we obtain 


2 
2-—k - Tk =0 


from which we get 


Hence, 


In what follows, we shall show that the response to initial conditions is deadbeat. 


Assume that the initial state is 
x 1(0) = a 
x2(0) b 
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The state feedback equation is 


x((k + 1)T) = (G — HK)x(kT) 


or 
1 T 
no on. 2 4 fous 
xX«(k *1T)] | 1  1|xX(kT) 
2 
Notice that 
T T 
x(T) 2 4 Ix) 2 4 2] 2575.40 
xD] | 1 1|m0]| | 1 alley | 1 -1, 
T 2 T ae 


T 2l 7°72 
Thus, clearly, the response is deadbeat. 
Now let us determine u(0) and u(T). Notice that 


u(kT) = -Kx(kT) = E zhen 


[ENERO 
uo- -|h zll- Tip 


id cb 
ele a ee Oo be 
un) =-| 4 a ee N T 
T 


Hence, 


For a = 1 and b = 1, we have 


1 3 1 1 
uO) = -a-p WT) = te 
T° 2T T° 2T 


In particular, for T = 0.1 sec, 


u(0) = —115, u(T) = u(0.1) = 105 
For T = 1 sec, 


u(0) = —2.5, u(T) = u(1) = 1.5 
For T = 10 sec, 
u(0) = —0.16, u(T) = u(10) = 0.06 


Notice that, for a small value of the sampling period T, u(0) and u(T) become large. 
Increasing the value of T reduces the magnitudes of u(0) and u(T) significantly. 
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Problem A-6-12 
Consider the system defined by 
x(k + 1) = Gx(k) + Hu(k) 


where x(k) is a 3-vector. It is assumed that the system is completely state controllable. 
By use of the pole placement technique, we wish to design the system to have closed- 
loop poles at z = m, Z = j42, and z = ps, where the ,’s are distinct. That is, using 
the state feedback control 


u(k) = -Kx(k) 
we wish to have 
\zI — G + HK| = (z - u)(z - p(z - m) = Z° + 2? + az + a 
Show that the desired state feedback gain matrix K can be given by 


K-[ 1 Iý & ë” (6-265) 
where 
&-(G-,D)'H, i-12,3 (6-266) 
Show also that the vectors &; are eigenvectors of matrix G — HK; that is, & satisfies the 
equation 


(G — HE)& = w&, i=1,2,3 
Solution Let us define 


G =G - HK 
By use of the Cayley-Hamilton theorem, G satisfies its own characteristic equation: 
Gra G + œG + a1 = o(G) - 0 (6-267) 
Consider the following identities: 
I-I 
G = G - HK 


Č? = (G - HK) = G? - GHK - HKG 
G = (G — HK)’ = G- GHK - GHKG - HKG’ 


Multiplying each preceding equation by as, o», a1, and a» (where ao = 1) in this order 
and adding the results, we obtain 
aI + mG + a G? + G = asl + mG + aG? + G — a HK 
— a, GHK - a, HKG - G?HK - GHKG - HKG’ 


Noting that the left-hand side of this last equation is 0, this last equation can be reduced 
to 


a2K + o, KG t KG 
0 = (G) - [H: GH: GH] aiK + KG 
K 


Hence, 
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œK + a, KG + KG? 
aK + KG = [H: GH: G^ B]! 6(G) 
K 


Premultiplying both sides of this last equation by [0 0 1], we obtain 
aK + o, KG + KG? 


[D O 1] a,K + KG -[0 0 1)[H!GH:G’?H]"'4(G) 
K 
or 
K-[0 0 1][H:GH:G'H]" 4(G) (6-268) 


which is Ackermann’s formula. Noting that 
$(G) = G + aG? + aG + al 
7 (G - wD(G — u;D(G — pst) 
we have 
K-[0 0 1J[H:GH:G' H] (G - ui D(G - 4; D(G — pal) 
By postmultiplying both sides of this last equation by &, = (G — p 1)7'H, we obtain 
K& = [0 0 1]J[H:GH:G'H]" (G - m D(G - i; D(G — W D(G — m DH 
-[0 0 1)[H: GH: G’H)"'(G - 4; D(G - u:1I)H (6—269) 

Let us define 

(G - 11 D(G - m1) = G + B2G + BoI 

(G — 1;D(G — sl) = G^ + 85G + Bul 

(G — ps I\(G — ju D) = G + 85G + BsI 
Then Equation (6—269) can be written as follows: 

K& = [0 0 1J[H:GH:G'H] " (G? + 85G + 85 DH 


Bos 
-[0 0 1)[H:GH:G?H]"'[H:GH:G?H]] &; 


=[0 0 1]| Be] =1 
1 


Hence, 
Kë = 1 
Similarly, we obtain 
Ké = 1, Ké, = 1 
Hence, 
K[& & £&]-[l 1 1] 


or 


K-[ 1 Uif & &]' (6-270) 
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Equation (6-270) gives the desired state feedback gain matrix K in terms of &, &, 
and £&;. 
To show that the &’s are eigenvectors of matrix G — HK, notice that 


(G — HK)Ẹ = (G - HK)(G — ,;,D^ H 

= (G — mI + wI- HK)(G - 4;D)'H 

= (G - m: D(G — 1)! H + (wil — HK)(G - 41) H 

=H + (pI - HK) 

-H- HKẸ + wik& (6-271) 
As we have shown earlier, 

Ké = 1, i=1,2,3 
Hence Equation (6-271) can be simplified to 
(G — HK): = pi &, i=1,2,3 
Thus, vectors £i, &, and £; are eigenvectors of matrix G — HK corresponding to 
eigenvalues 41, 42, and p3, respectively. 
Problem A—6-13 
Consider the system defined by 
x(k + 1) = Gx(k) + Hu(k) 

where x(k) is a 3-vector. It is assumed that the system is completely state controllable 
and that the deadbeat response to the initial state x(0) is desired. (That is, the desired 


closed-loop poles must be at the origin so that p, = 2 = ps = 0.) 
Show that the desired state feedback gain matrix K can be given by 


K=[1 0 Of[& & &]" (6-272) 
where 
&-G'H 
&=G?H 
&-G^?H 


Show also that the vectors £; are generalized eigenvectors of matrix G — HK; that is, 
& satisfies the equations 


(G = HK)& =0 
(G - HK)& = & 
(G - HE) = & 


Solution Referring to Equation (6-268), we have 
K-[0 0 1[H:GH:G'H] ' 9(G) 
where 
(G) = G 
Hence, 
K=[0 0 1[H:GH:GH] G? (6-273) 
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By postmultiplying both sides of Equation (6-273) by & = G^! H, we obtain 
K, -[0 0 1J[H:GH:GH]' GG H 
-[0 0 1i]J[:GH:G?H]" GH 


0 
=[0 0 ij[H:GH:G'H]"[R:GB:G?H]| 0 
1 
0 
=(0 0 yfoļ=1 
1 


Hence, 
Kg, = 1 
By postmultiplying both sides of Equation (6-273) by & = G?H, we obtain 
K&-[0 0 1)[H!GH:G’?H]'G@G?H 
-[0 0 1][H:GH:G?H]' GH 


0 
-[0 0 1J[H:GH:G'H]"[R:GH: G?H] 1| 2 0 
0 


Hence, 
Kë = 0 
Similarly, by postmultiplying both sides of Equation (6-273) by &; = G^?H, we obtain 
K; -[0 0 IJ[H:GH:G'H] GGH 
=(0 0 1|[H:GH:G?H]'H 
-[0 0 1j[R:GH:G'H]"[H:GH:G?H] =0 
Hence, 
Ké; = 0 
Consequently, we have 
K[E & &)=[1 0 0] 
Hence, 
K-[ 0 0f& & &]|" 


which is Equation (6—272). 
To show that £, is an eigenvector of matrix G — HK, notice that 


(G - HK)é, = (G - HR)G'H- H- HKG"'H = H — HKé, 
Since K£, = 1, we obtain 


(G — HK)& = 0 
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To show that £; = G ?H is a generalized eigenvector of matrix G — HK, notice that 
(G - HK)& = (G - HK)G 7H = G^H - HKG ^H = & - HK& 
Since K£; = 0, we obtain 
(G-HE)&-& 


Similarly, to show that £x = G ^H is a generalized eigenvector of matrix G — HK, 
notice that 


(G — HK)& = (G - HK)G?H = G?^H - HKG*H = & - HK& 
Since K£; = 0, we obtain 
(G - HK)& = & 
Problem A-6-14 
Consider the system defined by 
x(k + 1) = Gx(k) 
y(k) = €x(k) 


where x(k) is a 3-vector and y(k) is a scalar. It is assumed that the system is completely 
observable. It is desired to determine the observer feedback gain matrix K, for a 
full-order prediction observer such that the error dynamics have characteristic roots at 
Z = pa, Z = pa, and z = ps, Or 


|zI—- G + K.C| = (z - m)(z — ua) — us) 
= z? Tt az? + Qz + as 


Assume that the eigenvalues of G are Ai, Az, and A; and they are different from pa, p2, 
and us. We also assume that fi, u2, and us are distinct. 
Show that the matrix K, can be given by 


f&|'|1 
K. = f2 1 
fs 1 


where 
f, = C(G - I), i = 1,2,3 
Show also that the f ’s are eigenvectors of matrix (G — K. C)*; that is, f? satisfies the 
equation 
(G - K. CO)*f£? = mfr, i= 1,2,3 
where 7; is the complex conjugate of 4. (Note that any complex eigenvalues occur as 
conjugate pairs.) 


Solution Referring to Ackermann's formula as given by Equation (6-126) for the 
observer feedback gain matrix K., we have 


c [lo 
K. = $(G)| CG 0 
cG| |1 


Noting that 
(G) = G? T a, G? + a2.G + œl = (G = m Y(G un paD(G i pal) 
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we have 
c jo 
K. = (G - m D(G - 4; D(G — uD] CG 0 (6-274) 
CG’ 1 
By premultiplying both sides of this last equation by f, = C(G — i), we obtain 
ZIP 
f, K. = C(G — 4; D(G - 4,D)| CG 0 (6-275) 
CG’ 1 


Let us define 
(G — i4 I(G - pal) = G + B2G + Bul 
(G — mI)(G - mI) = G? + 85G + Bal 
(G — u5D)(G — mI) = G + 85G + Bul 
Then Equation (6—275) becomes 


CG’ 
CG? || CG? 


Hence, 


Similarly, we obtain 


Thus, 
f, 1 
tK. =| 1 
fs 1 
or 
fli 
K.-|f 1 (6-276) 
f 1 


Equation (6-276) gives the desired matrix K, in terms of f,, fz, and f, where 
£-C(G-ul)' i=1,2,3 
To show that the f? 's are eigenvectors of matrix (G — K, C)*, notice that 
(G — K.C)*f? = (G — K. O)*[C(G - 4,1) !]* 
= (G* - C*K?)(G* - nI)'c* 
= (Gt - mI + mI- C*K?)(G* - I) 'C* 
= C* + (mI — C*K?)f} 
= C* — C*K? f? + mf? (6-277) 
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As we have shown earlier, 
fK.-1 
Hence, 
Ki ff =1 
Thus, Equation (6-277) becomes 
(G - K.C)*f* = C* - C* + af! = uf 


We have thus shown that vectors ff, ff, and f? are eigenvectors of matrix (G — K. C)* 
corresponding to eigenvalues ju, u2, and u3, respectively. 


Problem A—6-15 


In Problem A-6-14 we obtained the observer feedback gain matrix K, for the case 
where the eigenvalues m, 2, and yx; of G — K. C were distinct. Suppose that we desire 
the deadbeat response for the error vector. Then we require that p, = 2 = u3 = 0. 
Show that for this case matrix K. can be given as follows: 


f| |0 fi |1 
K.-7|f 0 or K. = t 0 
f. 1 f; 0 


where 
f, = CG", t = CG, f; = CG? 


[Note that vectors f,, f2, and f; given here are the eigenvectors or generalized eigenvec- 
tors of matrix (G — K. C)*.] The system is assumed to be completely observable. 


Solution Referring to Equation (6-274), we have 


c [|o 
K. = (G — m D(G — ,5;D(G - ps] CG 0 
CG? 1 


By taking u, = uz = #3 = 0 and substituting accordingly in this last equation, we 
obtain 


c Ijo 
K. = G| CG 0 
CG’ 1 
which can be rewritten as follows: 
cG^?['|0 5| |0 
K,-|CG? O|=|f 0 (6-278) 
cG"! 1 f, 1 


Equation (6—278) gives the desired observer feedback gain matrix K, when pi = m = 
Bs = 0. 
Notice that Equation (6-278) can be modified to read 
CcG^? 0 
CG^|K.-|0 
cG“! 1 
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which is equivalent to the following three equations: 
CG^K. -f,K.-0 
CG^K., = £K. - 0 
CG"'K. -fK,-1 


Hence, we obtain 


fiK. f, 1 
f K. = £t K. — 0 
f;K. f, 0 
or 
f|'|1 
K. =| h 0 
fz 0 


which also gives the desired observer feedback gain matrix when Ma = p2 = ga = 0. 
Problem A-6--16 | 
Consider the system 
x(k + 1) = Gx(k) + Hu(k) 


s-[2 J} »-[r] 


Assume that the following control scheme is used: 
= -Kx 


By use of MATLAB, determine the state feedback gain matrix K such that the system 
will have closed-loop poles at 


z =0.5 + j0.5, z-05-j0.5 
Use Ackermann’s formula given by Equation (6-68). 


where 


Solution We first construct matrix J whose eigenvalues are the desired closed-loop 


poles. 
j= 0.5 + j0.5 0 
0 0.5 — j0.5 


The command poly(J) gives the characteristic polynomial for J. 


p = poly(J) 


p= 


1.0000 —1.0000 0.5000 


This is the MATLAB expression for the characteristic polynomial for J. 
poly(J) = 6) =F — J ^ 0.51 
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where I is the identity matrix. For the matrix 


[o 1 
s-| oa Ei 


the command polyvalm(poly(J), G) evaluates the following $(G): 


ur _[-o16 -1 ] [0o  1],[os o 
OO) Gee ee A ET HE A 
_fo34 -2 
032 2.34 


See the following MATLAB output. 


polyvalm(poly(J), G) 


ans — 


0.3400 | —2.0000 
0.3200 2.3400 


Referring to the Ackermann's formula given by Equation (6—68), the desired matrix 
K is obtained from 


= [0 1])[H GH]'4(G) 
= [0 1]M" &(G) 


where M = [H GH]. A MATLAB program for the determination of state feedback 
gain matrix K is given in MATLAB Program 6-4. 


i e the rank of controllability matixMis2, 
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: ^ e arbitrary pole placement is possible ***e* — 


cteristic polynomial by / (7 
J and oie poh)“ d . 


Problem A-6-17 


Consider the system 


x(k + 1) = Gx(k) + Hu(k) 


y(k) = Cx(k) 
where 
x(k) = state vector (3-vector) 
u(k) = control signal (scalar) 
y(k) = output signal (scalar) 
and 


0 
G-| 0 0 1 |, H =| 0], C-[0 1 0] 
1 
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1. Determine the state feedback gain matrix K such that the system will exhibit 
a deadbeat response to any initial state. Assuming that the state is completely measur- 
able so that the actual state x(k) can be fed back for control, or that 


u(k) = -Kx(k) 


determine the response of the system to the initial state 


x(0) = 


a esa 


where a, b, and c are arbitrary constants. 

2. Assuming that only a portion of the state vector is measurable, that is, only 
the output y(k) is measurable, design a minimum-order observer such that the response 
to the observer error is deadbeat. Assume that the system configuration is the same as 
that shown in Figure 6-11. 

3. Assuming that the observed state is used for feedback, obtain the response of 
the system to 


a 


x(0) =| 5 |, =la] 


[^ 


where é(0) is the initial observer error for the minimum-order observer and a, b, c, a, 
and P are arbitrary constants. 
4. Derive the pulse transfer function Gp(z) of the observer regulator. 


Solution Notice that the system is completely state controllable and observable. 


1. The required state feedback gain matrix K for deadbeat response can be 
obtained easily, as follows. Let us define 


K = [ki k2 ks] 
Then 
z -1 0 


lz1 - G + HK| = 0 z -1 
kt 05 k;*02 z tk; — 11 


= z? + (ks — 1.1)z? + (kz + 0.2)z + kı + 0.5 =0 


By equating this characteristic equation with the desired characteristic equation (for 
deadbeat response), 


we obtain 
K-[5 k ks] =[-0.5 -02 1.1] 
With this matrix K, the system equation becomes 
x(k + 1) = Gx(k) + Hu(k) = (G — HK)x(k) 


or 
x(k*0] [o 1 o] xo 
x(k + 1) = 0 0 1 x(k) 
x(k +1)| |0 0 Of xo 
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The response of this system to an arbitrary initial state becomes as follows: 


xi(1) 0 1 
x2(1) = 
x;(1) 


x,(2) 
x2(2) = 
x3(2) 


x(3) 
x,(3) = 
x3(3) 


e 


ooo ooo oo 
ooo oo 
oeo ooo o 
coco coc AFA 
ll ll 
ooo oon 


or 
x(k)=0, k=3,4,5,... 


Clearly, the response is deadbeat. 

2. We shall now design a minimum-order observer assuming that only the output 
y(k) is measurable. We shall first transform the state vector x(k) into a new state vector 
&(k) such that the output matrix C is transformed from [0 1 O]to[1 0 0]. The 
following matrix T will accomplish the required transformation: 


010 
T=/1 00 
0 0 1 
Thus, we define 
x(k) = T&(k) 


Then the system equations become 
E(k + 1) = T'GT&(k) + T^  H«(k) = G&(k) + Hu(k) 
y(k) = CT&(k) = C&(K) 


where . 0 1 Off 0 1 0 [010 
G-T'GT-|10 0| O 0 1 i100 
0 0 1|-05 -02 11]/0 0 1 
ps : i ^ Es Ge 
= [6.4 G 
-0.2 -0.5 11 dia 
! 0 1 ojjo 0 
H-T^?H-|1 0 0[0|-|0 
0 0 1|1 1 
. 010 
C-CT-[0 1 0]1 0 O|-[1 0 Of 
001 
The transformed system is thus given by 
Hk +Y)) [90390 1]|&40| |o 
&Kkt*1]|-2| 110 0 [| é()|- | 0 lulk) (6-279) 
&(k + 1) -0.2: -0.5 1.1 || &(k) 1 


&(k) 
y(k) = [1:0 o| &(k) (6-280) 
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Since only one state variable, &(k), can be measured, we need to observe two state 
variables. Hence, the order of the minimum-order observer is 2. Since 


^ ^ 0 0 ke 0 -k. 
Go» — Ke Go = Ee n H Fac 1] = Ee 141 - " 


the observer characteristic equation becomes 


k 


— Ĉĉ i ja}? e 
zT - Gas + K. Ga los z-11t ke 


= 2? + (key — 1.1)z — 0.5ke, 


The desired characteristic equation (for deadbeat response) is 
2=0 


Hence, we obtain 


or 


K= 


3. The equation for the state feedback control system with a minimum-order 
observer is given by Equation (6-163): 


(k*1|.|G-HK;  HKT [x (k) = 
|z (k +1) | i | 0 i Gss = K. SEA 6 281) 


Let us rewrite Equation (6-281) in terms of the new state vector &(k) and error vector 
&(k). Noting that the observed state is used for feedback, that is, 


u(k) = -R&() 


we have 
E(k + 1) = G&(k) + Hu(k) 
= G&(k) — HKE(k) 
= (6 — B&)&(k) + BIK[E(k) — &()] 
= (Ô — AK)é(k) + BKTé(k) 
where 
0 0 
r-|1 0 
0 1 
and 
. 010 
K-KT-[-05 -02 11]1 0 O|-[-02 -0.5 1.1] 
0 0 1 


Hence, Equation (6—281) can be modified to read 


[+2] - [Se [EO 
à(k*D0] L © 16» - K. Ga jak) 
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or 
&(k + 1) 001 0 0 | &(k) 
&(k + 1) 100 0 0 | &(k) 
é(k-1)|-2|0 0 0 -05 14|| &(k) 
é(k + 1) 000 0 O ff &(k) 
é(k + 1) 0 0 0 -05 0 || é(k) 


The response of this system to the given initial condition can be obtained as follows. 
First note that the assumed initial condition is 


x,(0) a 

x»(0) b 

x0)| —-|c 

é,(0) a 

éX(0) B 

Hence, 

&(0) b &(1) € 
&(0) a &(1) b 
&(0)| =| ¢ |, &(1) | =] -0.5a + 1.18 
é,(0) Q ê (1) 0 
é,(0) B é,(1) —0.5a 
&Q) —0.5a + 1.18 &(3) —0.55a 
&Q) c &(3) -0.5a + 1.18 
&(2) | = —0.55a , &(3) | = 0 
é,(2) 0 é,(3) 0 
é,(2) 0 é,(3) 0 
&(4) 0 &(5) 0 
&(4) —0.55a &(5) 0 
&(4)| = 0 | &(5) | =| 0 
é,(4) 0 é,(5) 0 
éx(4) 0 é,(5) 0 


The response is clearly deadbeat. For any initial condition, the settling time is at most 
five sampling periods. (This means that at most two sampling periods are needed for 
the error vector to become zero and, additionally, at most three sampling periods are 
needed for the state vector to become zero.) 

4. To derive the pulse transfer function Gp(z) of the observer regulator, we refer 
to the state equation and output equation given by Equations (6-279) and (6-280), 
respectively. The equations for the minimum-order observer are given by Equations 
(6-148) and (6-149), rewritten thus: 


&(k) — K.y(k) = (k) 
Ak + 1) = (Gos — K. Gas)a(k) + [(G, — Ke Gas) Ke 
+ Gra — K, Gaal y(k) + (Ap — K.H.)u(k) — (6-282) 


For this problem, 
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Hence, Equation (6—282) becomes 


ak +1) = ee shw + | tbo + He 


Taking the z transform of this last equation, we obtain 


za(z) = Be o [aco + Enc + HET 


i ? io = E 4 Hi 


Solving for H(z), we obtain 


or 


= 0 
@Z=| os ga Y) *|1jUC) 
"D z 
Equation (6-148) becomes 
z 0 z 
&G) = Hae * d) 
E 0 
T o5 0.2 [ER EUG 
11-5 -— z 
z z 


The control signal u(k) is given by 
u(k) = -K&Kk) = -[-0.2 -0.5  1.1]&(«) 
= 0.2y(k) - [70.5  1.1]&(k) 
The z transform of this last equation becomes 


U(z) = 0.2Y(z) -[-0.5 1.1] DAC 
-2i.t: 
0 
-[-06.5 1.1] 1 |U(z) 
P4 


0.5 05 02 1.1 
= [02 cum (a HRS 22) [ro == Ul) 
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or 


(: + Huc) - (-101 + E + 59 riy 


from which we get the pulse transfer function Gp(z) of the observer regulator as follows: 
U(z) _ 1.012? — 0.72z — 0.55 


G»( = "yj 7 z + Liz (6-283) 
The pulse transfer function of the plant can be obtained by use of Equation (5-60) 
as follows: 
.YG). -ig ¢ TET 
G,(z) = Uz) > C(zI - G)!'H- CCI- G)' Ë 


z 
|. z — 1.12? + 0.2z + 0.5 
A block diagram of the designed regulator system is shown in Figure 6-23. 


z 
z?=1.1z?+0.2z+0.5 


Gjlz) 


1.01 27~ 0.72 z- 0.55 
z?+1.1z 


~Golz) 


Figure 6-23 Block diagram of the regulator system designed in Problem A-6-17. 


Problem A-6-18 


Consider the servo system defined by Equation (6-185). The characteristic equation for 
the servo system is 


zLas — | G H | =0 (6284) 


K;-E;G-K,CG IL,- K.H - K,CH 
Rewriting Equation (6—284), we obtain 
| zL-G | -H | 


wee +e MMMM 4--------- -MM 


-K + K;G Tt Kı CG! zL, -= Ln + K;H t K,CH 


= [hee mmm a Loo 
-(K; + Ki C) tL, m K,C l zl, — Ln K: + K,C! Ln 


l 
[s-e peser n] 


KC i zim — Ls 


0 
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TAE, In 0 
| KiC(zIn — In) TL, 


-p - G+ HK, + HK, C + HK CzL,-L.)'| -H 


0 l zim -= Im 
= |zIn — G + HK; + HK, C + HK CL, - L;) "||zL, — In| = 0 (6-285) 


Equation (6—285) gives the characteristic equation for the system. We can determine 
matrices K, and K, so that the roots of this characteristic equation assume the desired 
values. For example, if deadbeat response to a step input is desired, then we determine 
K; and K; so that all roots of the characteristic equation are at the origin. [When the 
control u(k) is an m-vector (where m > 1), matrices K; and K; are not unique. That 
is, more than one set of K, and K; can be obtained. 

Referring to the servo system design problem discussed in Example 6-13, con- 
sider first the problem of determining an integral gain constant K; and a state feedback 
gain matrix K; by use of the characteristic equation given by Equation (6-284) or 
Equation (6-285) such that the unit-step response is deadbeat. Then consider a design 
of a full-order (third-order) prediction observer such that the response to the observer 
error is deadbeat. Defining the observer feedback gain matrix as K., determine this 
matrix by equating the coefficients of the powers of z of 


zi --G+K.C| =0 
and those of like powers of z in the desired characteristic equation, which is 
2-0 
Solution Let us define 
K: = [kı kı ks] 
Noting that 


0 1 0 0 
G=| 0 0 1, H=)01, -[05 1 0] 
-0.12 -0.01 1 1 
Equation (6-285) can be written as follows: 
Iz; = G + HK, + HK,C + HK, C(zl, S Wilz = I| 
- zl; - G + HK; + HK, C[1 + (z — 1) ]]|z — 1| 
z 00 0 1 0 0 
= 0 z 0|- 0 0 1]1+10 [ki kı ks] 
00 z —0.12 -0.01 1 1 
0 1 
+ ; [Ki][0.5 1 ofa + ES Iz — 1| 
z =l 0 
o 0 z =1 iz -1| 
0.12 + kı + ZA ER EE 
z m 0 
= 0 z -1 


(0.12 + k)(z — 1) + 0.5Kız (0.01 + kz — 1) + Kız (z - MP + ks(z — 1) 
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=2* + (—2 + ks)z? + (101 + ko — ka + K)z? 
+ (0.11 + kı — kı + 0.5K)z — 0.12 - kı =0 
This characteristic equation must be equal to 
2*=0 
Hence, we require 
-2-tk-0 
1.01 +k, —k3 + Ki =0 
0.11 + kı —k, + 0.5K, = 0 
-0.12 —k, =0 
from which we get 
K = 3, kı = —0.12, kı = 93 kz =2 
or 
K = 3, K = [-0.12 0.3233 2] 


[As a matter of course, these values agree with those given by Equations (6-199) 


and (6—200).] 
Next, we shall design a full-order prediction observer. Define 
ke, 
K. kez 
e3 
Then 
0 1 0 ke, 
G-K.C-| 0 0 1j- |] kea |[0.5 1 0] 
—0.12 -0.01 1 e3 
—0.5k., 1~k., 0 
= 0.5k.; =ke, 1 
—0.12 — 0.5k., —0.01 — kea, 1 
and we have 
z + 0.5ke, -1 + ka 0 
lzI - G + K,C| = 0.5k., z + ka -1 


0.12 + 0.5k, 0.01 + ka z-1 


= z? + (-1 + 0.5ke, + ke,)z? + (0.01 — 0.5k,, — 0.5ke, + kes)Z 
+0.12 — 0.115k., — 0.5ke, + 0.5ke, = 0 
This characteristic equation must be equal to the desired characteristic equation 
2-0 
Hence, we require 
—1+ 0.5k., + ka =0 
0.01 — 0.5k,, — 0.5k., + ke, = 0 
0.12 — 0.115k., — 0.5k., + 0.5k., = 0 
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Solving these three simultaneous equations for ke,, ken, and k.3, we obtain 


ka| [05192 
K. = | ke, | = | 0.7404 
ke, | | 0.6198 


This matrix gives the desired observer feedback gain matrix K.. 

Remember that the design of the integral gain constant K and the state feedback 
gain matrix K, (a pole placement problem) and the design of the observer feedback gain 
matrix K, (an observer problem) are independent problems. That is, matrix K, does 
not depend on K; and Ka, and vice versa. 


PROBLEMS 


Problem B-6-1 
Consider the system defined by 


(-0] fa bl xol, [1 
Bs + >| = E "a * Azo 
y(k) = t af 200 | 


Determine the conditions on a, b, c, and d for complete state controllability and 
complete observability. 


Problem B-6-2 
The control system defined by 


k+] fo i] 09] fa 
E + D] = EP HEJ t m 
eal 
x2(0) —1 


is completely state controllable. Determine a sequence of control signals u(0) and u(1) 
such that the state x(2) becomes 
Problem B-6-3 


x,(2) = —1 
x,(2) 2 
Consider the system 


0] [0o faw 1 
Ms + n| = EP Heg] * ENT 


CARE 
x2(0) -1 


Determine whether it is possible to bring the state to 


| kall- 
: x(2) —0.008 
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Problem B-6—4 
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Consider the system 


0 1 0 
x(k + 1) 0 0 1 x(k) 0 
x(k + 1) = a x(k) +/1 u(k) 
x(k + 1) a b ES x(k) 0 
Starting from the initial state 
1 
x(0) =| 1 
1 


determine whether or not the state x(3) can be brought to the origin. Also, determine 
whether or not the state can be brought to 


x(3) = 


m AM 


if the initial state is x(0) — 0. 
Problem B-6-5 
For the system defined by 


(k-1| [ 0 1 || x(k) 0 
ES + p] 3 E 20 j Hr 


»&) = [i ajz] 


assume that the following outputs are observed: 


»x0-21 y(1)=2 
The control signals given are 
u(0) = 2, u(1)= -1 
Determine the initial state x(0). Also, determine states x(1) and x(2). 
Problem B--6-6 


Show that the system 


x(k + 1) = G[x(k) + C*u(k)] 


y(k) = Cx(k) 
where 


x(k) = state vector (4-vector) 
u(k) = control signal (scalar) 


y(k) = output signal (scalar) 
and 
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ooo 


0 
2 1 
de 0 


0 
Ha c-[ 0 0 0 
0 


pe 
ocooor 


0 


is completely state controllable and completely observable. 
Show also that given any initial state x(0) every state vector can be brought to 
the origin in at most four sampling periods if and only if the control signal is given by 


u(k) = —Cx(k) 


Problem B—6-7 


Consider the continuous-time control system 
Xi =. 0 1 X1 0 
bl- AI] 
y=[3 TM 


This system is completely state controllable and observable. Note that the eigenvalues 
of the state matrix are 


A, = —3 + j4, A. = —3 — j4 


Thus, this system involves complex poles. 

As stated in Section 6-3, a system that is completely state controllable and 
completely observable in the absence of sampling remains completely state controllable 
and completely observable after the introduction of sampling if and only if, for every 
eigenvalue of the state matrix (root of the characteristic equation), 


Re Ài = ReA j 
implies 
27h 


Im (A; — Aj) # WT 


where T is the sampling period and n = +1, +2,.... 

Consider the discretized version of this system. Show that for this system, if the 
sampling period T is equal to 7/4 (where n = 1,2,3, . . .), then the discretized system 
is uncontrollable and unobservable. 


Problem B-6-8 


Consider the pulse-transfer-function system 
z (19427) 
(1 + 0.5z )(1 — 0.5277) 
Referring to Section 6-4, obtain the state-space representation of the system in the 
following forms: 


G(z) = 


1. Controllable canonical form 
2. Observable canonical form 
3. Diagonal! canonical form 
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Problem B-6-9 


Consider the pulse-transfer-function system 


1-4 0.82! 
1-z!-40.527? 


Obtain the state-space representation of the system in the following forms: 


G(z) = 


1. Controllable canonical form 
2. Observable canonical form 
3. Diagonal canonical form 


Problem B-6—-10 
Consider the following system given in the controllable canonical form: 
x(k + 1) 0 1 0 x(k) 0 
x(k +1)|/=] 0 0 1 || x(k) | + | 0 ju(k) 
x(k + 1) —7ü3 —â2 “a x(k) 1 
, xi(k) 
y(k) = [bs — as bo: b; — az boibi — ai bo]| x2(k) | + bou(k) 
x3(k) 


It is desired to transform the system equations into the observable canonical form by 
means of the transformation of the state vector: 


x = Qx 
Determine a transformation matrix Q that will give the desired observable canonical 
form. 
Problem B-6-11 


Consider the double-integrator system 


x((k + 1)T) = Gx(kT) + Hu(kT) 


MEN. [rn 
s-[o ih [m 


and T is the sampling period. (See Problem A-5-16 for the derivation of this discrete- 
time state equation for the double-integrator system.) 

It is desired that the closed-loop poles be located atz = 4: andz = m. Assuming 
that the state feedback control 


where 


u(kT) = -Kx(kT) 


is used, determine the state feedback gain matrix K. 


Problem B-6-12 
Consider the system defined by 
xı(k + 1) 0 1 0 x(k) 1 
xXk *1)]2| 0 0 1 || x2(k) | + | 1 Ju(k) 


x(k-*1)|] |-016 084 O|] xs(k)} | 1 
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Determine the state feedback gain matrix K such that when the control signal is 
given by 

u(k) = -Kx(k) 
the closed-loop system will exhibit the deadbeat response to any initial state x(0). 


Problem B-6-13 


Consider the system 


x(k + 1) = Gx(k) + Hu(k) 


y(k) = Cx(k) 
where 
x(k) = state vector (2-vector) 
u(k) = control signal (scalar) 
y(k) = output signal (scalar) 
and 


0 1 0 
TEP 4] 4-1 c-[p i 


Design a current observer for the system. It is desired that the response to the initial 
observer error be deadbeat. 


Problem B-6—14 
Consider the system 


x(k + 1) = Gx(k) + Hu(k) 


y(k) = Cx(k) 
where 
x(k) = state vector (3-vector) 
u(k) = control signal (scalar) 
y(k) = output signal (scalar) 
and 
0 0 —0.25 1 
G=|1 0 0 |, H=|0!, cC=fi 0 0] 
01 05 1 


Assuming that the output y(k) is measurable, design a minimum-order observer such 
that the response to the initial observer error is deadbeat. 


Problem B-6-15 
Consider the system defined by 


x(k*1) | 0 1 || x(k) 0 

ee +97] -016 -1| x99 | * | 1 XO 

Using MATLAB, determine the state feedback gain matrix K such that when the 
control signal is given by 
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u(k) = -Kx(k) 


the closed-loop system (regulator system) exhibits the deadbeat response to an initial 
state x(0). Write a MATLAB program for the determination of state feedback gain 
matrix K. 


Problem B-6-16 
Consider the system defined by 
x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) 


[r2 oe com 


Using MATLAB, determine the observer feedback gain matrix K. such that the desired 
eigenvalues for the observer matrix are 


Ma = 0.5 + j0.5, H2 = 0.5 = j0.5 


Assume that the system configuration is identical to that shown in Figure 6-8. Using 
Ackermann's formula, write a MATLAB program. 


Problem B-6—17 


Figure 6-24 shows a servo system where the integral controller has a time delay of one 
sampling period. (Compare this system with the servo system shown in Figure 6-18.) 


where 


| 
ee] 


Integral controller 


| 
| 


Figure 6-24 Servo system with state feedback and integral control involving a unit 
delay in the feedforward path. 


Determine the feedforward gain K, and the feedback gain K, such that the 
response to the unit-step sequence input r(k) = 1 (where k = 0,1,2,...) is deadbeat. 
Plot the response y(k) versus k. 


Problem B-6-18 


Consider the servo system shown in Figure 6-25. (This system is similar to that shown 
in Figure 6-24, except that the integral controller has a unit delay element in the minor 
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Figure 6-25 Servo system with state feedback and integral control involving a unit 
delay in the minor loop. 


loop.) Determine the feedforward gain K, and the feedback gain K; such that the 
response to the unit-step sequence input r(k) = 1 (where k = 0,1,2,...) is deadbeat. 
Plot the response y(k) versus k. 


7 


Polynomial Equations 
Approach to Control 
Systems Design 


7-1 INTRODUCTION 


In Chapter 6 we designed state-feedback control systems using the pole placement 
technique. If some of the state variables were not directly measurable, we used 
observed states for the feedback purpose. The entire design was done in state space. 

A different approach to the design of similar systems is available. It is called 
the polynomial equations approach. It is an alternative approach to the design via 
pole placement with a minimum-order state observer. (The polynomial equations 
approach can be applied to multiple-input-multiple-output systems. However, we 
shall consider only single-input-single-output systems in this chapter.) 

This chapter presents an introductory account of the polynomial equations 
approach to control systems design. In this approach we solve Diophantine equa- 
tions to determine polynomials in z that can be used in constructing necessary, 
physically realizable systems. This approach gives the mathematical solution to 
certain types of the design problem quickly. 

The outline of this chapter is as follows: Section 7-1 has given an introductory 
remark. Section 7-2 discusses Diophantine equations and provides necessary math- 
ematical preliminaries for the polynomial equations approach to the control systems 
design. Section 7-3 presents a simple example demonstrating the polynomial equa- 
tions approach to the design of a regulator system having a desired characteristic 
polynomial. Section 7—4 discusses the polynomial equations approach to the design 
of control systems. Section 7—5 treats the design of a model matching control system. 
Here we design the system such that the response of the system to any input is the 
same as that of the specified mathematical model. To design such a system, we 
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determine, based on the polynomial equations approach, physically realizable filters 
that will produce the desired system characteristics. 


7-2 DIOPHANTINE EQUATION 


In this section we shall discuss the Diophantine equation. Consider the system 
defined by the pulse transfer function 
Y(z2) B(z) 
U() A(z) 


(7-1) 


where 
A(z) =z" + a,2"!4+ +--+ 4,12 + a, 
B(z) = boz” + bz" +--+ + briz +b, 
Assume that this pulse transfer function system is completely state controllable and 
completely observable. That is, there is no pole-zero cancellation in the pulse 
transfer function, or A(z) and B(z) have no common factors. When polynomials 
A(z) and B(z) have no cancellation, these polynomials are called coprime poly- 
nomials. A polynomial in z is called monic if the coefficient of the highest-degree 
term is unity. Thus, polynomial A(z) is monic. 
Next, let us define a stable (2n — 1)th-degree polynomial D(z) as follows: 
D(z) = doz”! + dyz”? tcx d, -2Z t dua 
Then there exist unique (n — 1)th-degree polynomials a(z) and B(z) such that 
a(z)A(z) + B(z)B(z) = D(z) (7-2) 
where 
a(z) = az" ! + az"? + -+ au az + aua 


B(z) = Boz" + Biz"? tec Bn-2Z + Br-1 


Equation (7-2) is called a Diophantine equation, named after Diophantus of Alex- 
andreia (A.D. 246?-330?). The Diophantine equation can be solved for a(z) and B(z) 
by use of the following 2n x 2n Sylvester matrix E, which is defined in terms of the 
coefficients of coprime polynomials A(z) and B(z) as follows: 


an 0 0 b, 0 0 
or Gn 0 bna b, 0 
4-1 0 : ba 0 
a : : b : : 
E= 1 Qa "M ân bo bi see b, (7-3) 
0 1 5-1 0 bo b, 
0 0 a 0 0 b, 
0 0 1 0 0 bo 


[To use Equation (7-3) polynomial A(z) must be monic. Otherwise, we must modify 
Equation (7-3).] If n = 4, then this matrix becomes as follows: 
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a4 0 0 0 b, 0 0 0] 
a, a, 0 0 b, b, 0 0 
Qa, a, ay 0 b; b, b, 0 
a Qa, 03 ay b 1 b; b, b, 


a, a3 bo b, b, b; 


1 ay 
0 1 ay 
0 0 1 a 0 0 b, b 
0 0 0 


The Sylvester matrix E is nonsingular if and only if A(z) and B(z) are coprime, 
or have no common factors. This fact may be seen from the following: Referring to 
the preceding 8 x 8 matrix E, the determinant |E| becomes as follows: 


A4 0 0 0 b, 0 0 0 
ay ay 0 0 b, b, 0 0 


IE| = 1 Qj a, ay bo b, b; b; 
0 1 aa 0 by b, b 
0 0 1 ay 0 0 bo b, 
0 0 0 1 0 0 0 b, 
= bóli — A3) — As)(Ar — A7)(À1 — Ag) 
* (Az = A36 — Ao)(Az — As) — As) 
: (Az — As)(A3 — Ae)(A3 — A7)(A3 7 A9) 
e (Ag = As)(Ag — Ag)(Ag = A) — Ag) (7-4) 
where a,,...,@, and b,,..., b, are coefficients of A(z) and B(z), respectively, and 
Ai,...,Aq and As,...,Ag are characteristic roots of A(z) and B(z), respectively: 


A(z) = 24 + az? taz + azz + a= (z — M)(z — M)(z — A)G - X) 
B(z) = by z* + bz t b,z? t baz + b, = bo(z T As)(z = Ae)(z = Az d As) 


From Equation (7-4) it is clear that the determinant |E] is nonzero if and only if all 
multiplicative factors on the right-hand side of the equation are nonzero, that is, if 
and only if no cancellation occurs between A(z) and B(z). [For the derivation of 
Equation (7—4), refer to Problem A-7-1.] 

Now define vectors D and M such that 


0,11 
dos. d 
do,-2 ` 
D= : ; M= "i 
d, B. 
dy ue 
Bo 
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Then the coefficients ao, 04, .. . , @,-; and Bp, By, . .. , Bn- can be determined from 
M-E'D (7-5) 

Equation (7-5) gives the solution to the Diophantine equation. [For the derivation 

of Equation (7-5), see Problem A-7-2.] 

Example 7-1 


Consider the following A(z) (a monic polynomial of degree 2), B(z) (a polynomial of 
degree 1), and D(z) (a polynomial of degree 3): 


A(z)=z?+z+0.5 
B(z)=z+2 
D(z) = z 


[Clearly, there is no common factor between A(z) and B(z).] The problem here is to 
find unique polynomials a(z) and B(z) such that 


a(z)A(z) + B(z)B(z) = D(z) 


where 
a(z) = aoz + oi 
B(z) = Boz + Bi 
or 
(aoz + a1)(z* + z + 0.5) + (Boz + B)(z + 2) = 2? (7-6) 


Equation (7-6) is a Diophantine equation. To solve this equation for a(z) and A(z), 
first note that 


a, = 1, a, = 0.5 


bo = 0, bi = 1, b, =2 
and then write the Sylvester matrix E as follows: 
05 0 2 0 
.|[1 05 1 2 
Be 101 
0 1 00 


The inverse of such a matrix can be obtained easily if MATLAB is used. The MATLAB 
output for the inverse of matrix E is shown next. 


0 
2.0000 


1.0000 
0 
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ans — 


0.4000 —0.8000 . 1.6000 


0 0 0 
0.4000 0.2000 -—0.4000 
—0.4000 0.8000 .-—0.6000 


Since 


we have 
do = 1, d, = 0, d; = 0, d,=0 


Thus, matrix D becomes 


d; 0 
_| ad 0 
D-lq 70 
do 1 
By defining matrix M as 
Qi 
ao 
M = 
Bi 
Bo 
the solution to the Diophantine equation is obtained from 
M-E'D 


as follows: 


M = (inv(E)*D 


M= 


— 1.2000 
1.0000 
0.3000 
0.2000 


From this MATLAB output, we obtain 
a, = —1.2, a = 1, Bi = 0.3, Bo = 0.2 
or 
a(z)=az+a=z-1.2 
B(z) = Boz + f| = 0.2z + 0.3 


The polynomials a(z) and B(z) thus determined will satisfy the Diophantine equation 
given by Equation (7-6). To verify, notice that 
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(z — 1.22 + z + 0.5) + (0.2z + 0.3)(z + 2) 
= 2° — 1.2z? + z? — 1.2z + 0.5z — 0.6 + 0.22? + 0.3z 
+ 0.4z + 0.6 


= 2° 


7-3 ILLUSTRATIVE EXAMPLE 


In Chapter 6 we discussed the pole placement approach to the control systems 
design. It was stated that some of the state variables might not be available for direct 
measurements, and in such case the pole placement approach required estimated or 
observed states for feedback. 

Let us refer to Example 6—11, where we discussed the state feedback regulator 
system. In that system the desired characteristic equation was given, and one of the 
state variables was estimated by use of the deadbeat-type minimum-order observer. 
In this section we shall show that the same regulator system can be designed by use 
of the polynomial equations approach. 


Regulator System Designed in Example 6-11. The regulator system designed 
in Example 6—11 is shown in Figure 7-1. The plant is completely state controllable 
and completely observable. (No cancellation occurs between the numerator polyno- 
mial and the denominator polynomial.) The sampling period was 0.2 sec, or T — 0.2. 
The controller was designed based on the pole placement approach by specifying the 
desired closed-loop poles at 


Z2] = 0.6 + j0.4, Z: = 0.6 — j0.4 


and by incorporating a minimum-order observer to estimate one of the state vari- 
ables for feedback. The minimum-order observer had the observer error equation 
of 


$(2) 7 z 
The regulator designed was 


z — 0.6667 
Go(z) = 24( z + 0.32 


0.02 (z + 1) 
(z-1? 


(7-7) 


Figure 7-1 Regulator system designed 
in Example 6-11. 
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In what follows we shall present the polynomial equations approach to design 
the same regulator as given by Equation (7-7) by solving a Diophantine equation. 


Polynomial Equations Approach to Design Regulator System. Consider the 
block diagram shown in Figure 7-2. The feedback pulse transfer function B(z)/a(z) 
serves as a regulator. Let us determine a(z) and A(z) by use of the polynomial 
equations approach. First note that the pulse transfer function of the plant is 


Y(z) B(z) 0.02(z + 1) 
U(z) A(z) (z —1y 
[A(z) is a monic polynomial of degree 2 and there is no cancellation between A(z) 
and B(z).] Then, although R(z) = 0, the closed-loop pulse transfer function for the 
system can be given by 
Y(z) |. a(z)B(z) m 0.02(z + 1)a(z) 
R(z) a(z)A(z) + B(z)B(z) a(z)z — 1} + B(z)0.02(z + 1) 
As stated earlier, in Example 6-11 we required the desired closed-loop poles for 
state feedback to be 


zı —0.6-j04, z, = 0.6 — j0.4 
or the desired characteristic polynomial was 
H(z) = (z — 0.6 — j0.4)(z — 0.6 + j0.4) 


=z? — 1.2z + 0.52 
The desired minimum-order observer error polynomial was 
F(z)=z 


To determine a(z) and A(z), we solve the following Diophantine equation: 
a(z)A(z) + B(z)B(z) = F(z)H(z) = D(z) (7-8) 
where 
D(z) = F(z)H(z) = doz? + dizi + dz + d; = zi — 1.22? + 0.52z 


Note that D(z) is a stable, (2n — 1)th-degree polynomial in z (where n = 2 in the 
present case). Since 


A(z) - 0 Biz) _ 002 (z +1) 


A(z) (z- a 


Figure 7-2 Block diagram of regulator system. 
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A(z) =2*-2z+1 
B(z) = 0.02z + 0.02 
we have 
a, = —2, a=1, by = 0, b, = 0.02, b; = 0.02 


By substituting the polynomial expressions for A(z), B(z), and D(z) into Equation 
(7-8), we obtain 


a(z)(z? — 2z + 1) + B(z)(0.02z + 0.02) = z2 - 122? + 0.52z 


To solve this Diophantine equation for a(z) and B(z), we first define 2n x 2n (where 
n = 2) Sylvester matrix E: 


1 0002 0 
E = -2 1 0.02 0.02 

1-2 0 00 

0 1 0 0 


The inverse of matrix E can be obtained easily by use of MATLAB as follows: 


0.25 —0.285 025 0.75 
0 0 0 1 
37.5 12.  -125 -37.5 
-12.5 12.5 37.5 62.5 


a(z) and (z) are polynomials of degree n —1—-2—1-71,or 


E` = 


a(z) = œz + ay 


B(z) = Boz + Bi 
Define 
d; 0 a 
ole] mL u-la 
dy 1 Bo 
Then vector M is determined from 
0.25 —0.25 0.25 0.75 0 0.32 
M=E'D=| J^ n5 -ns -35l 421" ]--16 
-12.5 12.5 37.5 62.5 1 24 
Hence, 


a, = 0.32, ag = 1, Bı -16, By = 24 
Therefore, a(z) and B(z) are determined as 
a(z) = œz + a = z + 0.32 
B(z) = Boz + Bi = 24z — 16 


am. 
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and the feedback regulator is obtained as 


BO) _ (=) 
a(z ^ \ z +0.32 


which is identical to that designed in state space by the method based on pole 
placement combined with a minimum-order observer. 


7-4 POLYNOMIAL EQUATIONS APPROACH TO CONTROL 
SYSTEMS DESIGN 


In Section 7-3 we designed a regulator system by use of the polynomial equations 
approach. The block diagram of the regulator system designed is shown in Figure 
7-3. Remember that a(z) and (z) were determined from the following Diophantine 
equation: 


a(z)A(z) + B(z)B(z) = H(z)F(z) 


where A(z) is a monic polynomial of degree n, B(z) is a polynomial of degree m 
(m = n) [we assume that there are no common factors between A(z) and B(z)], 
H(z) is the desired characteristic polynomial for pole placement part, and F(z) is 
the characteristic polynomial for the minimum-order observer. [Both polynomials 
H(z) and F(z) are stable polynomials.] The degree of polynomial H(z) is n and the 
degree of polynomial F(z) is n — 1. (We assume that the system output is the only 
measurable state variable. Therefore, the order of the minimum-order observer is 
n — 1.) 

In the following we discuss the design of control systems based on the poly- 
nomial equations approach. We consider two different control system config- 
urations. 


Control System Configuration 1. The regulator system shown in Figure 7-3 
can be modified to a control system such that the output follows the reference input. 
A possible block diagram for the control system is shown in Figure 7-4. As a control 
system, it is necessary to have an adjustable gain Ky. This gain Ky should be set such 
that the steady-state output y(k) is equal to unity when the input r(K) is a unit-step 
sequence. 


Figure 7-3 Block diagram of 
regulator system. 
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Figure 7-4 Block diagram of control 
system. 


The closed-loop pulse transfer function Y(z)/R(z) is 


B(z) 
Y(z) _ A(z) 
R@) "|, BG)BG) 

A(z)a(z) 


2k a2) Bz) 

"a(z)A(z) + B(z)B(z) 

a(z)B(z) 

HEFG) e 
Notice that the closed-loop system is of (2n — 1)th order, unless cancellation occurs 


between a(z)B(z) and H(z)F(z). Notice also that the numerator dynamics has been 
changed from B(z) to Kya(z)B(z). 
To determine gain Ko, we set 
lim y(k) - lim (1 - z)Y() 

«2-1, a(z)B(z) z 

x um z Kvi)F(z) z-1 
a(1)B(1) 
H(1)F(1) 


= Ky 


= Ky 


=1 
from which we get 
. HWFA) 


Ko = DBO) 


Example 7-2 

In the regulator system considered in Section 7-3, 
A(z) = (z - 17 
B(z) = 0.02(z + 1) 
H(z) = z? - 1.2z + 0.52 
F(z) =z 
a(z) = z + 0.32 
B(z) = 24z — 16 
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Hence, the closed-loop pulse transfer function Y(z)/R(z) is obtained from Equation 
(7-9) as 

Y(z) Ke(z + 0.32)(0.02)(z + 1) 

R(z) sz — 1.227 + 0.52z 
Note that Ko in this case is given by 
HF). 0.32 x 1 
a(1)B(1) 1.32 x 0.04 
Notice that the system is of third order. The unit-step response and the unit-ramp 


response of this system with Ko = 6.0606 were shown in Figures 6-16 and 6-17, 
respectively. 


Ko = = 6.0606 


Control System Configuration 2. A control system with a different block 
diagram configuration may be designed by use of the polynomial equations ap- 
proach. Consider the block diagram shown in Figure 7—5. (To figure out how such 
a block diagram came out, see Problem A-7-3.) 

From Figure 7-5, we obtain the following equation: 


uc) - -|ue - vo + ovo] + rro 
which can be simplified to 
a(z) _ B(z) 
F(z) U(z) = F(z Fo O + Ky R(z) (7-10) 
The pulse transfer function of the plant is 
Y(z) _ BG) 
U(z) A(z) 


where A(z) is a monic polynomial of degree n and B(z) is a stable polynomial of 
degree m (m = n). Since 

A(z) 
B(z) 


U(z) = Y(z) (7-11) 


Figure 7-5 Block diagram of control system. 
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by substituting Equation (7-11) into Equation (7-10), we obtain 


e(2)AG) , BG], 
Kena t lre = KoR@) 


Then 
Y(z) _ Ko 
RG) a@)A@) , BG) 
F(z)B(z) F(z) 
_ Ko F(z) B(z) 
~ a(z)A(z) + B(z)B(z) 
Since 
a(z)A(z) + B(z)B(z) = H(z)F(z) 
we obtain 


Y(z _ KoF(z)B(z) _ KoB(z) 7-12 
RG) HG)G) ` HQ) 012) 
Notice that the observer polynomial F(z) has been canceled [since F(z) is a stable 
polynomial, cancellation of F(z) is permissible], and the characteristic polynomial 
for the closed-loop system is given by H(z). H(z) is a desired, but in a sense 
“arbitrarily chosen," stable polynomial of degree n. Thus, the control system de- 
signed is of the nth order. (In the case of control system configuration 1, the order 
of the system is 2n — 1, unless cancellations occur in the designed system, resulting 
in the reduction of the system order.) Notice also that the numerator dynamics of 
Y(z)/R(z) has not been changed in the present approach. [The numerator is B(z) 
times constant K,.] 


Example 7-3 


Let us design a control system based on the block diagram shown in Figure 7-5. The 
plant we consider is given by 


B(z) 0.02(z + 1) 
A(z) (G-1y 


(The sampling period T is 0.2 sec.) We shall use the same desired closed-loop poles as 
those used in Example 7-2, or 


zi = 0.6 + j0.4, z2 = 0.6 — j0.4 
and use the same desired minimum-order observer polynomial, or 
$(z) =z 
Let us write the desired characteristic polynomial as H(z), 
H(z) = (z — 0.6 — j0.4)(z — 0.6 + j0.4) 
=z? — 1.2z + 0.52 


and the desired observer characteristic polynomial as F(z), 
F(z) =z 
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and solve the following Diophantine equation: 
a(z)A(z) + B(z)B(z) = H(z)F(z) 


or 

a(z)(z — 1)? + B(z)(0.02)(z + 1) = z? - 1.22? + 0.52z (7-13) 

Equation (7-13) was solved in Section 7-3 and a(z) and B(z) were obtained as follows: 
a(z) = z + 0.32 


B(z) = 24z — 16 
Using these a(z) and A(z) and referring to Equation (7-12), the closed-loop pulse 
transfer function Y(z)/R(z) can be written as follows: 


Y(z) _ KoB(z) _ Ko(0.02z + 0.02) 
R(z) H(z) 2? — 1.2z + 0.52 


To determine constant Ko, we require y (o) in the unit-step response to be unity. 
lim y(k) = lim (1 — z )Y(z) 
Kk z1 

z — 1 Ko(0.022 + 0.02) z 


—H p eari 
Ko 
= —— = 1 
8 
Hence, Ko is determined as 
Ko = 8 


Then the closed-loop pulse transfer function becomes 


Y(z) _ _0.16z + 0.16 
R(z) z^-12z + 0.52 


Clearly, the system designed is of second order. A block diagram for the designed 
system is shown in Figure 7-6(a). Figure 7-6(b) shows a simplified block diagram. 

Next, we shall examine the unit-step response and the unit-ramp response of the 
system just designed. MATLAB Program 7-1 is used to obtain the unit-step response. 
The resulting unit-step response is shown in Figure 7-7. MATLAB Program 7-2 gives 
the unit-ramp response. The resulting response is shown in Figure 7-8. 

The steady-state error e(%) in following the unit-ramp input is obtained as 
follows: Since 


Y(z)  8(0.02z + 0.02) 
R( z-12z + 0.52 
we have 
E(z) = R(z) - Y(z) = |: - ZO n) 
_ (z - Iz - 0.36) 
~ P12 +052 50 
where 


0.2z 


Te esee 
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0.02 (z « 1) 
(z- 1 


Yiz) 


(a) 


8(0.02z + 0.02) 
22-122 + 0.52 


(bi 


Figure 7-6 (a) Block diagram of the control system designed by use of polynomial equations 
approach; (b) simplified block diagram. 


Hence, 


; _ zZ—1(z-—1)(z- 0.36) 0.2z 
Baro sum Se e T 


= 0.4 


The steady-state error in following the unit-ramp input is 0.4. 
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Unit-Step Response 


CELLS Me [Uses 9 Sg ee OF000900 0939000000000 00090 


y(k) 


Figure 7-7 Unit-step response of control system shown in Figure 7-6(b). 


MATLAB Program 7-2. 
im [0 016 0.16]; 
den=[1 -1.2 0.52]; 
ke020 _ 
re[o2*] — 
v=[0 20 0 4); 


axis(v); 

y = filterínum,den,t); i 
plot(k y,'o',k,y,'-* k,0. 2*k,'--") 
grid e 
title'Unit-Ramp Response’) 
xlabel('k') 

ylabel('y(k)') 


In comparing the unit-step responses of the systems under control system config- 
uration 1 and control system configuration 2, they are about the same. In comparing 
the unit-ramp responses of the two systems, the system under configuration 2 has 
approximately 10% smaller steady-state error in following the unit-ramp input than the 
system under configuration 1. 
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Unit-Ramp Response 


yh) 


Figure 7-8 Unit-ramp response of control system shown in Figure 7-6(b). 


7-5 DESIGN OF MODEL MATCHING CONTROL SYSTEMS 


In the design technique presented in Section 7—4 (under control system configura- 
tion 2), the observer polynomial F(z) has been canceled between the numerator and 
denominator of the closed-loop pulse transfer function. [See Equation (7-12).] The 
characteristic equation of the designed system was H(z), a stable polynomial of 
degree n. [H(z) was a desirable, but in a sense “arbitrary,” stable polynomial 
of degree n.] 

Suppose that the pulse transfer function of the plant is 


EG) HU) 
U(z) AQ) 


where A(z) is an nth-degree monic polynomial in z and B(z) is an mth-degree 
polynomial in z (m =n), where we assume that there are no common factors 
between A(z) and B(z). If B(z) is a stable polynomial (meaning that all zeros lie 
in the unit circle in the z plane), it may be possible to choose H(z) such that it includes 
polynomial B(z), or 


H(z) = B(z)H,(z) 
Then, referring to Equation (7-12), we can have 


Y(z) E Ko B(z) = Ko B(z) = Ko 
R(z) i H(z) ~ B(zHy(z) Hz) 
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Thus, we eliminated the zeros of the numerator polynomial, which means that we 
can eliminate the zeros of the plant if we so desire. 

Suppose that we wish to have desired zeros in the numerator and desired poles 
in the denominator. That is, we would like to have the system to possess desired poles 
and zeros like a “model system," or 


Y(z) B.(z) 
R(z) A,,(z) 


Under certain conditions, it is possible to design such a system by use of the poly- 
nomial equations approach. Since we force the pulse transfer function of the con- 
trol system exactly like the model, we call such a control system a model matching 
control system. 

In the design process discussed in Section 7-4, we chose H(z) as the desired 
characteristic polynomial of degree n. [H(z) is a stable nth-degree polynomial, but 
is not unique, but rather arbitrary, provided the response of the system is accept- 
able.] Let us choose a stable polynomial of degree n — m as H,(z). (H;(z) must be 
a stable polynomial, but in a sense arbitrary, provided the response of the resulting 
system is acceptable.] Now we define the product of B(z) and Hi(z) as H(z), or 


H(z) = B(z)H«(z) 


Model Matching Control System. We first refer to the block diagram of Fig- 
ure 7-9. We assume that the plant B(z)/A(z) is completely state controllable and 
completely observable; that is, there are no common factors between A(z) and B(z). 
We determine a(z) and B(z) by solving the following Diophantine equation: 


a(z)A(z) + B(z)B(z) = F(z)B(z) H(z) 


where F(z) is a stable polynomial of (n — 1)th degree. [Note that a(z) and B(z) 
are polynomials of (n — 1)th degree.] Then, from the block diagram of Figure 7-9, 
we have 


= G modet = 


U(z) = Jg U(z) - U(z) + MI + Vz) 


F(z) F(z) 


Gmodet H(z) 


Figure 7-9 Block diagram of model matching control system. 
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or 
FB UG) + POY) = V) 
Since 
Uc) = Se YG) 
we have 
O Ore) + EO Ya) = V(z) 

or 

Yo)  F(Q)Bz)  — . F()BG) . 1 

V(z) e(2)A(z) + B(z)B(z) F(z)B(z2)HiG) H(z) 
Also, 

V(z) = Grodet Hi(z)R(z) 

Hence, 


YO) _ ¥@)V@) _ Goa Hiz) _ G 
RG) Vz) Rz) H6)  "" 


We thus have seen that if we set 


VG). 
R(z) G model H(z) 

then the pulse transfer function between the output Y(z) and the input R(z) becomes 

Gmod: Hence, we achieved model matching control. 


Comments. In applying the present approach to the design of model match- 
ing control systems, it is important to remember the following: 


1. To make the pulse transfer function Grose H(z) physically realizable, the 
degree of the numerator polynomial of Groce H;(z) must be equal to or less 
than the degree of the denominator polynomial of Ga Hi(z). Otherwise, the 
present approach does not apply. 

2. As noted earlier, the numerator polynomial B(z) of the plant must be a stable 
polynomial, because the cancellation of B(z) takes place between the numer- 
ator and denominator of Y(z)/V(z). [If B(z) were not a stable polynomial, that 
is, B(z) possesses a zero or zeros on or outside the unit circle, then cancellation 
of B(z) in Y(z)/V(z) will generate unstable response and the designed system 
will become unstable.] 


Example 7-4 
Consider the plant defined by 


Y(z) _ 0.3679z + 0.2642 
U(z) (z — 0.3679)(z — 1) 


E 
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Assume that the sampling period T is 1 sec. It is desired to design a control system such 
that the closed-loop system will behave like 


Y.(z) = 0.62z — 0.3 

R,(z) 2? ~ 1.2z + 0.52 
Let us call this pulse transfer function the model pulse transfer function, or Gmoaei, and 
Y,,(z) _ _ 0.627 — 0.3 
R«(z) 27 — 1.2z + 0.52 


Let us assume that we use the system configuration given in Figure 7-9. Note that for 
the given plant, 


G model = 


(7-14) 


A(z) = z? — 1.3679z + 0.3679 
B(z) = 0.3679z + 0.2642 
Hence, 
a, = —1.3679, à; = 0.3679 
bo = 0, b, = 0.3679, b; = 0.2642 
Clearly, the numerator B(z) is a stable polynomial. 
Since the pulse transfer function of the plant is of second order (or n = 2), we 


choose Hi(z) as a stable, first-degree [(n — 1) degree] polynomial. For example, we 
may choose Hi(z) as 


Hi(z) 2 z * 0.5 
[Choice of H(z) is, in a sense, arbitrary as long as it is a stable polynomial.] Now define 
A(z) = B(z)Hi(z) = (0.3679z + 0.2642)(z + 0.5) 
Next, we choose 
F(z) =z 
[F(z) can be any stable (n — 1)th-degree polynomial.] Then 
D(z) = F(z)H(z) = F(z)B(z)Hi(z) = z(0.3679z + 0.2642)(z + 0.5) 


= 0.3679z? + 0.4482z? + 0.1321z 
Hence, 


d, = 0.3679, d, = 0.4482, d, = 0.1321, d,=0 
Now we need to solve the following Diophantine equation: 
a(z)A(z) + B(z)B(z) = F(z)B(z)Hi(z) 
or 
a(z)(z? — 1.3679z + 0.3679) + B(z)(0.3679z + 0.2642) 
= 0.3679z° + 0.4482z? + 0.1321z 


where a(z) and B(z) are first-degree polynomials in z, respectively. The 4 x 4 Sylvester 
matrix E for this problem becomes as follows: 


a 0 bh 0 0.3679 0 0.2642 0 
g2|^ % b, baf | —1.3679 0.3679 0.3679 0.2642 
11 a bo bı 1 —1.3679 0 0.3679 


0 1 0 b 0 1 0 0 
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Then, by use of MATLAB, E^! can be obtained as shown next. 


0 0.2642 
0.3679 0.3679 
—1.3679 0 
1.0000 0 


inv(E) 


ans = 


0.5359  —0.3849 
0 0 
3.0387 . 0.5359 
—1.4567 1.0461 


Define 
dz 0 a 
_ | dad] _ | 0.1321 | eo 
D-|g|^lo48»^ M-^|g 
do 0.3679 Bo 
Then matrix M is obtained as follows: 
0.2642 
_ pin _ 0.3679 
M-E D-| _ 0.3679 
1.8680 


Hence, 
a(z) = aoz + a = 0.3679z + 0.2642 
B(z) = Boz + Bı = 1.8680z — 0.3679 
Using a(z) and A(z) thus determined, Y(z)/V(z) becomes as follows: 
Y(z) F(z)B(z) 1 1 


Since V(z)/R(z) is 
V(z) _ . (0.62z — 0.3)(z + 0.5) 
RE) HG) = — 797 + 0.52 


the pulse transfer function Y(z)/R(z) becomes 


Y(z) _ _0.62z — 0.3 
R(z) zi-12z + 0.52 
The designed model matching control] system has the block diagram as shown in Fig- 


ure 7-10(a). This block diagram can be simplified to those shown in Figures 7-10(b) 
and (c). 


= G moaer 
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(a) 


Riz) 0.622 - 0.3 Y) 
z*- 1.2z + 0.52 


(c) 


Figure 7-10 (a) Block diagram of model matching control system; (b) and (c) simplified block 
diagrams. 


The unit-step response and unit-ramp response of the model system are shown 
in Figures 7-11 and 7-12, respectively. The unit-step response exhibits approximately 
30% overshoot in the response, and the error in following the unit-ramp input is 
approximately 0.55. 


Comments. Itis important to note that the present approach is different from 
multiplying the following filter (pulse transfer function) 


(z — 0.3679)(z —1) 0.62 — 0.3 
zi- 1.2z 40.52 0.3679z + 0.2642 


to the plant. Although, mathematically, the product becomes 


(z — 0.3679) — 1) 0.627 — 0.3. 0.3679z + 0.2642 — — 0.62z — 0.3 
z? -12z + 0.52 0.3679z + 0.2642 (z — 0.3679(z — 1) zi—12z + 0.32 


and the resulting system has the pulse transfer function of the model, in this case 
cancellation takes place between a critically stable pole at z = 1 and zero at z = 1, 
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Unit-Step Response 


ytk) 


Figure 7-11 Unit-step response of model Groce: given by Equation (7-14). 


Unit-Ramp Response 


yd 


Figure 7-12 Unit-ramp response of model G,44 given by Equation (7-14). 
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and the system will become unstable. [Remember that we should never cancel an 
unstable (or critically stable) pole and zero.] In the present polynomial equations 
approach, no cancellations take place between unstable (or critically stable) poles 
and zeros in the entire design process and, therefore, the resulting system is always 
stable. 

If no steady-state error in following the ramp input is desired, then we need 
to change the model. For example, if we use the following pulse transfer function 
as the pulse transfer function of the revised model 


, ^ 2 0.8z - 0.48 
model “2? — 1.2z + 0.52 


then the steady-state error in following the ramp input becomes zero. However, the 
maximum overshoot in the unit-step response becomes approximately 45%. The 
unit-step response and unit-ramp response of the revised model are shown in Figures 
7-13 and 7-14, respectively. 

Note that changing the model does not change the block diagram between Y(z) 
and V(z), because Y(z)/V(z) is independent of the model pulse transfer function. 
Therefore, if a change of the model is desired, all we need is to change the pulse 
transfer function of the first block from G moge! to G^. 


(7-15) 


Unit-Step Response 


y(k) 


Figure 7-13 Unit-step response of model G;,,44 given by Equation (7-15). 
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Unit-Ramp Response 


ye 


Figure 7-14 Unit-ramp response of model Gioaa given by Equation (7-15). 


EXAMPLE PROBLEMS AND SOLUTIONS 


Problem A-7-1 
Consider polynomials 
A(z) = 2 +az +a 
B(z) = boz? + biz + b; 
The Sylvester matrix E is defined by 


a2 0 b2 0 

a @& bi b; 
1 ay bo b 1 
0 1 0 b 


Show that matrix E is nonsingular if and only if there is no cancellation between 
polynomials A(z) and B(z). 


Solution Let us assume that the roots of A(z) = 0 are A, and A; and those of B(z) = 0 
are As and A,. Thus, 


A(z) = 2? + az +m = (z ~ Mz — à) 
= 27 — (M + An)z + à A2 

B(z) = boz? + biz + b; = bo(z — M)(z — Aa) 
= boz? — bo(As + Aa)z + bo A3 A4 
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Hence, 
a, = —(Ai + Ad), d; = Ài Àz 


b, = —bo(Às + Aa), b; = bos A4 
Let us write matrix E in terms of A’s. 


à À2 0 boÀ3À4 0 
E- -(Ai + À2) Ài À2 —bo(As + Aa) bo As Àa 
1 -(Ah t A2) bo —bo(As + Aa) 
0 1 0 bo 


The determinant of matrix E can be calculated by use of Laplace’s expansion by minors. 


JEI = A À2 0 bo T bo (A5 + As) = À1 À2 0 —bo(As t Aa) bo A3A4 
-(a*A) AA 0 bo 1 -(u*AÀ) 0 bo 

+ Ai À2 0 pee + Aa) bo À3À4 + a + A2) A À2 bo À3 À4 0 

0 1 bo —Do(As + Aa) 1 -(u*AgM 0 bo 
-[* + A2) A À2 boÀ3AÀ4 0 $ f -(À + A2) boÀ3À4 0 

0 1 |] bo —b(A +A" lo — 1 —bo(As + As) boAsAa 


= MA b, — (AT Az + ALAZ)BG(As + Aa) AA RO + 2A3Aq + AZ) — Ai bZ A3 Ag 
+ (AZ + As + ADbo As As — biu + Az)(As + Ag)Ag Ag + b2 A222 
= b(A AZ — A? Az Às — ALAZA3 — AZ ADAG — ALAZ Ag 
+ ALAZAZ + A1 Àz Às A4 + ALADAT + AZ A3 Àa + AL AD As Ay 
+ AZ As Àa 7A. — ARA — AUS AL — ASA + AZAZ) 
Rearranging the terms on the right-hand side of this last equation, we obtain 
IE] = Bo(AT AZ — A1 AZ A3 — AL AZ A4 + AŽ A3 Àa — AŽ A2 A3 
+ Àr AA + AX — ADAZAg — A? A2 Aa 
+ Ar Àz Àz Àa + Àr A2 A4 — A223 AZ + A? As Àa 
= MA3 Aa — Ar Às AR + AZAZ) 
= bo(AT — Ar Às — Ar Àa + A3 Aa)(AZ — Az A3 — Az A4 + Az Àa) 
= boli — As)(Ar — Aa)(A2 — As)(Az — As) 


The determinant |E] is nonzero unless at least A, = As or Ay = Ay Or Az = A5 OF Ap = Ay. 
Hence, E is nonsingular if and only if no cancellation occurs between A(z) and B(z). 
That is, if A(z) and B(z) are coprime polynomials, then [E| is nonzero and E^! exists. 


Problem A-7-2 
Assume that polynomials A(z) and B(z) have no cancellations and are given by 
A(z) =z +az+a@ 
B(z) = boz? + biz T b; 
Then the Sylvester matrix E is given by 
a2 0 b; 0 
a, Ge b, b, 


1 «a bo bi 
0 1 0 b 
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Define 
a(z) = aoz + ai 
B(z) = Boz + B 
D(z) = doz? + dz? + dzz + ds 
Show that if 
a(z)A(z) + B(z)B(z) = D(z) 


then ao, a1, Bo, and B, can be determined by computing 


M=E'D 
where 
d3 Qı 
d; Qo 
D = M= 
dı , fi 
do Bo 


Solution First, notice that 
a(z)A(z) + B(z)B(z) = (aoz + a1)(z? + aız + a2) + (Boz + Bi)(boz? + biz + b2) 
= (ao + Bobo)z? + (a1 + aoa: + Bibo + Bobi)z? 
+ (ardı + aod; + Bibi + Bob2)z + aaz + ib; 
= D(z) = doz? + diz? + daz + ds 
Hence, 
do = ag + Bobo 
dy = a + aoa: + Bibo + Bobi 
dz a8 + aod; + Bibi + Bobo 
d3 = aia; + fib; 
Now compute EM. Since 


ait + Bib; 

0104, + Aa, + Bibi + Bob; 
01 + aoa, + Bi bo + Bibi 
a + Bobo 


comparing each element of the right-hand side of this last equation with ds, d», dı, and 


do, respectively, we have 


EM = =D 
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Hence, 
M-E'D 
or the coefficients of polynomials a(z) and B(z) can be determined by multiplying E^! 
by D. 
Problem A-7-3 


In Chapter 6 we designed regulator systems and control systems using the observed- 
state feedback scheme. In single-input-single-output systems, the output is always mea- 
surable. Hence, in such systems we may need minimum-order observers, rather than 
full-order observers. 

Consider the regulator system designed by the pole placement approach com- 
bined with the minimum-order observer. The plant equations are 


x(k + 1) = Gx(k) + Hu(k) 
y(k) = €x(k) 


where x is an n-vector, u(k) is a scalar, and y(k) is also a scalar. We assume that the 
plant is completely state controllable and completely observable. The plant equations 
can be rewritten as 


a(k +1)] [Ga Ga [x0] [H 
Bn + 5 E [es ee me] Ui Faz 
y(k) = [1 of 00 | 


where y(k) = xa(k) is the measurable state variable and x,(k) consists of unmeasurable 
state variables. 

The equation for the observer regulator (controller) can be derived from Equa- 
tions (6-148), (6-149), and (6-159), rewritten thus: 


x(k) — K.y(k) = a(k) (7-16) 
Ak + 1) = (Gas — K. Ga )(K) 
+ [(Gss — Ke Gas)Ke + Goa — Ke Gaal y(k) 
+ (Hy — K.H,)u(k) (7-17) 
u(k) = -K&(Kk) (7-18) 


where K is the state feedback gain matrix and K, is the observer gain matrix. Define 


e»-[t]- e 
where x(k) is an n-vector and X,(k) is an (n — 1)-vector consisting of (n — 1) observed 
state variables. Define also 

K-^[k k;] 
Then Equation (7-18) becomes 


u(k) = [he ZH = -k y) - ko ko(k) (7-19) 
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Show that the regulator (or controller) equation can be given by 


UG) _ BG) 
Y(z) a(z) 


Gp(z) = 


where 
a(z) = k, W(z)Q + F(z) 
B(z) = (kı + ks K.) F(z) + ks W(z)P 
P = (Gss — Ke Gas)Ke + Goa - Ke Gaa 
Q-H,-K.H, 


F(z) = |zI — Gs, + K. G.s| = characteristic equation for the minimum- 
order observer (stable polynomial of degree n — 1) 


W(z) = (zI — Gə + K. Ga) ! F(z) 


Show also that the block diagram for the regulator system can be given as shown in 
Figure 7-15. 


Solution Taking the z transform of Equation (7-17), assuming zero initial conditions, 
we obtain 


zH(z) = (Gas — K.Go)n(z) + [(G» - K. Ga) K- 
+ Goa — Ke G.]Y(z) + (Hs — Ke H.)U(z) 
= (Ga, — K. Ganz) + PY(z) + QU(z) 

which can be written as 

(zI — G» + K. Go )n(z) = PY(z) + QU(z) 
Solving this last equation for H(z), we have 

H(z) = (zI - Gæ + K. Ga) '[PY(z) + QU(z)] (7-20) 

Since 


W(z) - WG) 


m EKG) = mer rni" 
(zI — Gæ + K. Ga) lz1— G» + K.Gs| F(z) 


Figure 7-15 Block diagram of the regulator system. 
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Equation (7-20) becomes as follows: 


à) = FS Pre) + QUE) (7-21) 
By substituting Equation (7-16) into Equation (7-19), we obtain 
u(k) = —kiy(k) — k, [Key (k) + (K)] 
The z transform of this last equation gives 
U(z) = -kiY(z) - ko[K. ¥(z) + H(z)] (7-22) 
Substituting Equation (7-21) into Equation (7-22) gives 


U(z) = -kı Y(z) - k, K. Y(z) — ks ESI » [PY(z) + QU(z)] 
"e ) 


we )p 


~k, 


k, W(z)Q + F(z) 
tan no - n 
Using a(z) and B(z) defined in the problem statement, Equation (7-23) can be written 
as follows: 
U(z) = ES U(z) + U(z) - Ee Y) (7-24) 
from which we get 
a) vc, = -&e 
or 
U(z) _ B) 
TYG) ` al) 0-25) 


[Note that F(z) is a stable polynomial. Hence, two F(z)'s can be canceled.] Equation 
(7-25) is the equation for the regulator (or controller). The block diagram representa- 
tion of Equation (7-24) becomes as shown in Figure 7-15. (This corresponds to a 
regulator system.) If this block diagram is incorporated into the control system, we 
obtain the block diagram of Figure 7-5. 


Problem A-7-4 


Referring to the example system discussed in Section 7-3 (the regulator system designed 
in Example 6-11) and Problem A-7-3, verify that 


a(z) = k,W(z)Q + F(z) = z + 0.32 
B(z) = (kı + ke Ke)F(z) + k W(z)P = 24(z — 0.6667) 
Solution Referring to Example 6-11, we have 
x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) 
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F(z) =z 
W(z) = (z - Gy + Ke Gas) F(z) 2(z-145x02)!z-1 
Hence, 
a(z) = k,W(z)Q + F(z) =3.2X%1x014+2z 
=z + 0.32 
B(z) = (ki + ks K.)F(z) + ke W(z)P 
= (8 + 3.2 x 5)z + 3.2 x 1 x (-5) 
= 24z — 16 = 24(z — 0.6667) 
Problem A-7-5 


Polynomial Equations Approach to Control Systems Design 


where 
[1 02 _ [0.02 - 
c=} 2| u-[2| c={ 0] 


Gaa = 1, Gab = 0.2, Gba = 0, Gop = 1, 
H, = 0.02, H, = 0.2 
For the pole placement part, the desired characteristic equation was 


iz1- G + HK| = z? — 1.2z + 0.52 = 0 


Hence, 
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The state feedback gain matrix K for the desired characteristic equation was 


obtained as 
K=[8 3.2] 
Hence, 
k, = 8, ky = 3.2 


For the minimum-order observer part, the observer characteristic equation was 


$(z) =z =90 
The observer gain K. was obtained as 
K.=5 
Hence, P, Q, F(z), and W(z) are obtained as follows: 
P = (Gu — KeGas)Ke + Ga — Ke Gaa 
-(1-5x02)x540-5x1--—5 
Q = H, — K.H, = 0.2 — 5 x 0.02 = 0.1 


Show that the block diagram of Figure 7-5 can be modified to that shown in Figure 7-16. 


Solution The block diagram of Figure 7-5 can be modified to that shown in Figure 


7-17. Since the pulse transfer function of the minor loop is 


UG). — 1 FQ) 
X(z) a(z) , a(z) 
Ear 


by eliminating the minor loop we obtain the block diagram of Figure 7-16. 
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Figure 7-17 Block diagram of Figure 7-5 modified to that having a minor loop. 


Problem A-7-6 
Consider a plant defined by 
Y(z) _ 1 
U(z 2? +2z+0.16 
Using the polynomial equations approach, design a control system for this plant based 


on the block diagram shown in Figure 7-5. Assume that the desired characteristic 
equation is 


H(z) = (z — 0.6 — j0.4)(z — 0.6 + j0.4) 


=z? — 1.2z + 0.52 
and F(z) (minimum-order observer polynomial) is 
F(z) =z 


Solution Referring to Figure 7-5, a(z) and B(z) are determined from the following 
Diophantine equation: 


a(z)A(z) + B(z)B(z) = H(z)F(z) = D(z) 
where 
A(z) » z? * z * 0.16 
B(z) =1 
D(z) = z? - 1.22? + 0.52z 
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The Sylvester matrix E for this case is 


016 0 10 
|] 1 016 0 1 
E- i 1 00 

0 1 00 


The inverse of matrix E can be obtained as follows: 


0 0 1 -i 
0 0 0 1 
1 0 -0.16 0.16 
01 -1 0.84 


Note that a(z) and B(z) are polynomials of degree n — 1 = 2 — 1 = 1, respectively, or 


E` = 


a(z) = az + a 


BG) = Boz + B 
Define 
ds 0 [^4] 
E d; € 0.52 _ | 9o 
De d| |-12[ M- Bı 
do 1 Bo 
Then vector M is determined from M = E ! D as follows: 
-2.2 
M=E'D= 1 
0.352 
2.56 


Hence a(z) and B(z) are determined as 
a(z) =z -2.2 
B(z) = 2.56z + 0.352 


Referring to Equation (7-12), the designed system has the closed-loop pulse transfer 
function Y(z)/R(z) as follows: 


Y(z). Ko B(z) = 1 


R(z) H(z) °z? — 1.2z + 0.52 
Next we need to determine gain Ko in Figure 7-5. We require the steady-state 
output y(%) to a unit-step input to be unity, or 


Ko z 


; EU NENNEN CHEN: PEN 
lim y(k) = lim z 212405271"! 


from which we obtain 


Ko = 0.32 
Hence, the pulse transfer function of the designed system becomes as follows: 
Y(z) _ 0.32 


R(z) z-12z + 0.52 


A block diagram for the designed system is shown in Figure 7-18. A unit-step response 
of the designed system is shown in Figure 7-19. 
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1 
22.24 0.16 


Figure 7-18 Block diagram of the system designed in Problem A-7-6. 
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Figure 7-19 Unit-step response of the system designed in Problem A-7--6. 


Problem A-7-7 


In Problem A-6-17 we considered the design of the regulator system where the plant 
was defined by 


x(k + 1) = Gx(k) + Hu(k) (7-26) 
y(k) = Cx(k) (7-27) 


where 


0 
G=| 0 0 1| H=/ol, c=f0 1 9 
1 
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We used the pole placement approach to determine the state feedback gain matrix K 
such that the regulator system would exhibit a deadbeat response to any initial state. 
We used a minimum-order observer such that the response to observer error was 
deadbeat. 

Using the polynomial equations approach, design an equivalent control system 
for this plant such that the block diagram configuration is the same as that of Fig- 
ure 7-4. Obtain the unit-step response and unit-ramp response of the designed system. 
The sampling period T of the system is 0.2 sec. 


Solution Referring to Problem A-6-17, the desired characteristic equation was 
|I- G + HK|- z2-0 
Hence, we define 
H(z)-z 
The observer error characteristic equation was 
lz1 - 6, + Ke G4| = z2 = 0 
Therefore, we define 
F(z) = z? 
Next, we find the pulse transfer function G,(z) of the plant. 
G,(z) = CzI - G) ! H 


2. cu o ['|0 
-[ roo z -1 | Jo 
05 02 z-141| |1 
i 1 
=D or Osa + 022 +05] 5 
aa SE oO 
z2 -1.172 + 0.2z +0.5 A(z) 
where 
A(z) = 2? — 11z? + 0.2z + 0.5 
B(z)-z 
Hence, 


a= —1.1, a= 0.2, a= 0.5 
bo = 0, b, = 0, b, = 1, b-0 


Referring to Figure 7-4, the block diagram for the present system can be drawn as 
shown in Figure 7-20. 
The characteristic polynomial for the entire system (observed-state feedback 
system) is 
D(z-H(zF(z)-z-:z-z 


Hence, 
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From the block diagram of Figure 7-20, the characteristic equation for the system is 
a(z)A(z) + B(z)B(z) = 0 
Hence, in the polynomial equations approach we set 
a(z)A(z) + B(z)B(z) = H(z)F(z) 
or 
a(z)(z — 1.12? + 0.2z + 0.5) + B(z)z = 2° 


To determine the pulse transfer function B(z)/a(z) of the controller, we solve this 
Diophantine equation. 

For the present problem, n = 3 and the 2n x 2n Sylvester matrix E becomes a 
6 x 6 matrix as follows: 


0.5 0 0 000 

0.2 0.5 0 100 

E- -11 02 05010 
1 -11 02 00 1 

0 1 -11000 

0 0 1 00 0 


We can easily obtain E! by use of MATLAB, as shown next. 


0.5000 0 
0.2000 0.5000 
—1.1000 0.2000 
1.0000  —1.1000 
1.0000 

0 


To determine a(z) and B(z), we first define 


ds 0 a2 

d, 0 [44] 

= d; e 0 Ta Qto 

D d, ol M n 
dı 0 fi 

do 1 Bo 


552 Polynomial Equations Approach to Control Systems Design Chap. 7 


1 Yiz) 


Figure 7-20 Block diagram of the control system considered in Problem A-7-7. 


and then determine M by 
M-E'D 
which can be calculated easily by MATLAB as follows: 


D = [0;0;0;0;0;1]; 
M = (inv(E)*D 


M= 


We can now determine a(z) and B(z) as follows: 

a(z) = aoz^ + az + os — 274+ 1.12 

B(z) = Boz? + Biz + B; = 1.0127 — 0.722 — 0.55 
Hence, the controller designed is 


BZ) _ 1.012? — 0.72z — 0.55 
a(z) z? + 1.1z 
Notice that this pulse transfer function of the controller is the same as Equation (6-283), 
the pulse transfer function of the observer controller derived in Problem A-6-17. 
Referring to Figure 7-20, the closed-loop pulse transfer function becomes as 


follows: 
g Be) 
¥@)__ ""A() __ Koalz)B(2) 
RG) ,,BG)BG) a(G)AG)* BG)BG) 
a(z) A(z) 


_ Koa(z)B(z) _ Ko(z? + 1.1z)z _ Ko(z + 1.1) 
= H()F() 2 i z 
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Notice that cancellation of z? occurred between a(z)B(z) and H(z)F(z) and the system 
is of the third order. [The system would have been of the (2n — 1)th order (or fifth 
order) if no cancellation occurred. ] 

To determine gain Ko, we impose the condition that the steady-state output y («c») 
to the unit-step input is unity, or 

_ ~1K(z+11) z — 
lim n y(k) lim z 2 z-1 2.1Ko = 1 
Hence, 
Ko = 0.4762 


and the closed-loop pulse transfer function becomes 


Y(z) _ 0.4762(z + 1.1) _ 0.4762z + 0.5238 
R(z) | 2 7 z 
The system is of third order. The unit-step response of the designed system is shown 
in Figure 7-21. Notice that in the unit-step response the output reaches unity in three 
sampling periods. 
The unit-ramp response of the designed system is shown in Figure 7-22. The error 
in following the unit-ramp input can be calculated as follows: 


E(z) = RG) - YG) = E -tO e ) 


_ ( 1 04762 + 0. sme) 


R(z) 
-Dz “3 + 0.5238) pz) 


Unit-Step Response 


y(k) 


Figure 7-21 Unit-step response of the system designed in Problem A—7-7. 
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Unit-Ramp Response 


Figure 7-22 Unit-ramp response of the system designed in Problem A-7-7. 


The unit-ramp input R(z) is given by 


Tz! 0.2z 
R(z) ~ (1 _ zy m (z _ 1)° 
Hence, 
. | .z-1( — Ie’? + z + 0.5238) 02z 
lim e(k) B lim z 2 (z - 19 


= 0.5048 
Thus, the error in following the unit-ramp input is 0.5048, as can be seen in Figure 7-22. 


Problem A-7-8 
Referring to Problem A—7-7, consider the same plant as given by Equations (7-26) and 
(7-27). (Refer also to Problem A-6-17.) Assume the same polynomials H(z) and F(z) 
as used in Problem A-7-7. 

Using the polynomial equations approach, design a control system for the plant 
such that the block diagram configuration is the same as that of Figure 7-5. Then obtain 
the unit-step response and unit-ramp response of the designed system. The sampling 
period T of the system is 0.2 sec. 

Solution For this problem 
H(z)= z2, F()-z 
Referring to Problem A-7-7, the pulse transfer function G,(z) of the plant is 
z _ B(z) 
z’ -— 1.12? + 0.2z + 0.5 A(z) 


G,(z) = 
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The block diagram for the present system is shown in Figure 7-23. The Diophantine 
equation for this problem is 


a(z)AG) + B(z)B(z) = H(z)F(z) 
or 
a(z)(z? — 1.1z? + 0.2z + 0.5) + B(z)z = 25 
This Diophantine equation was solved in Problem A-7-7 and the result was 
a(z) = z? + 1.1z 
B(z) = 1.012? — 0.72z — 0.55 


Hence, referring to Equation (7-12), the closed-loop pulse transfer function Y(z)/R(z) 
is given by 
Y(z) _ KoB(z) 
R(z)  H(z) 
or 
Y(z ) Ko z Ko 


Rz) 2 z 
To determine gain Ko, we impose the condition that the steady-state output y (o) to the 
unit-step input is unity, or 


z-1Ke, z 
A 


Bye) lim z z za d 
Hence, 
Ko-1 
Thus, Y(z)/R(z) becomes as follows: 
Yc) 1 
R(z) 2 


The system designed is of second order. The unit-step response of the designed system 
is shown in Figure 7-24. Notice that in the unit-step response the output reaches unity 
in two sampling periods. 


Figure 7-23 Block diagram of the control system considered in Problem A-7-8. 
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Unit-Step Response 


ylk) 


Figure 7-24 Unit-step response of the system designed in Problem A-7-8. 


The unit-ramp response of the system is shown in Figure 7-25. The error in 
following the unit-ramp input can be calculated as follows: 


E(z) = R(z) - Y(z) = |: - XC) nto) 
-] 1 
- h - Lae -EDE +D Re) 
The unit-ramp input R(z) is 
Tz! 0.2z 


POSU- rP G-I 


Hence, 


-1(G-1(*1 
z—-i(z-1DG ) 02z - 04 


mm I CZ 


Thus, the error in following the unit-ramp input is 0.4, as can be seen in Figure 7-25. 
Comparing the systems designed in Problems A-7-7 and A-7-8, the latter system 
that uses the block diagram configuration of Figure 7-5 exhibits superior behavior. 


Problem A-7-9 
Consider a plant defined by 


z+0.5 
G2) = 33 4001 * 0.12 
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Unit-Ramp Response 


ylk) 


Figure 7-25 Unit-ramp response of the system designed in Problem A-7-8. 


The sampling period T is 1 sec. Assume that in the present probiem it is important to 
have zero following error to a ramp input. 

It is desired to design a controller such that the control system will behave like 
the model system, whose pulse transfer function is 


Gonos = Ck = 0512 
modei (z? — 1.2z + 0.52)(z — 0.6) 
0.64z — 0.512 


~ 33 — L8z + 124z — 0.312 (7-28) 


(The sampling period for the model! is also 1 sec.) The unit-step response and unit-ramp 
response of the model system Ginoge: are shown in Figures 7-26 and 7-27, respectively. 
(The steady-state error in following the ramp input is zero, and the maximum overshoot 
in the unit-step response is approximately 70%.) 


Solution Let us assume that the block diagram of the system is the same as that of 
Figure 7-9. For the given plant, 


A(z) = z? — z? + 0.01z + 0.12 
B(z) =z + 0.5 
Thus, 
a, = -1, a2 = 0.01, az = 0.12 
bo = 0, b, = 0, b, =1, bs = 0.5 
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Unit-Step Response 


y) 


Figure 7-26  Unit-step response of the model system G4 given by Equa- 
tion (7-28). 


Unit-Ramp Response 


y(k) 


Figure 7-27 Unit-ramp response of the model system Gros given by Equa- 
tion (7-28). 
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Clearly, there is no common factor between A(z) and B(z). In this problem we may 
choose Hi(z) as 


H(z) = z? - 12z + 0.52 


Here we chose Hi(z) to cancel a part of the denominator of Gs. [But this is not 
necessary. Requirement on H;(z) is that it must be a stable polynomial of degree n — 1 
(n = 3 in this problem). Infinitely many choices of Hi(z) are possible.] Define 


A(z) = B(z)Hi(z) 
= (z + 0.5)(z? — 1.2z + 0.52) 
= 2° -0J7z — 0.08z + 0.26 
Next we choose F(z) as 
F(z) = 2? 


[F(z) must be a stable polynomial of degree n — 1. In this case, again, infinitely many 
choices are possible.] Then D(z) becomes as follows: 


D(z) = F(z)H(z) = F(z)B(z)H:(z) 
= z5 — 0.7z* — 0.082? + 0.2627 

Hence, 

d=1, d,=-0.7, dz = —0.08, 

d3 = 0.26, d4=0, ds=0 
Now we need to solve the following Diophantine equation: 

a(z)A(z) + B(z)B(z) = F(z)B(z)Ai(z) 
or 

a(z)(z? — z? + 0.01z + 0.12) + B(z)(z + 0.5) = z? — 0.7z* — 0.082? + 0.262? 


The 6 x 6 Sylvester matrix E for this problem is 


0.12 0 0 0.5 0 0 
001 0.12 0 1 05 0 
zc 001 20120 1 05 
^| 1 =1 0.01 0 0 1 
0 1 -1 0 0 0 
0 0 1 0 0 0 
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By use of MATLAB, E '! can be obtained as shown next. 


0.2308 
—0.4423 
0.9615 
Define 
ds 0 a 
da 0 Qi 
[di 0.26 Qt 
D-|4,|7 -0.08 b M b 
dı —0.7 fi 
do 1 Bo 
Then vector M can be obtained from 
M-2E'D 


MATLAB computation of this equation is shown next. 


D = [0;0;0.26; —0.08;—0.7;1]; 
M = (inv(E))*D 
M= 

—0.1000 


0.3000 
1.0000 
0.0240 
—0.1180 
0.3100 


From vector M we get values of a’s and f?'s. a(z) and A(z) are determined as 
a(z) = az? + az + œ = z? + 0.3z — 0.1 


B(z) = Boz? + Biz + B = 0.312? — 0.118z + 0.024 
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Using a(z) and B(z) thus determined, Y(z)/V(z) becomes as follows: 
Y(z2 F(z)B(z) 1 1 


V(z) - F(z)B(z)H,(z) = H(z) z — 1.2z + 0.52 
Since V(z)/R(z) is 


V@) _ 


_ (0.64z — 0.512)(z? — 1.2z + 0.52) 
R(z) -= Gmoaei Hi(z) — 


(z? — 1.2z + 0.52)(z — 0.6) 


_ 0.64z — 0.512 
z —0.6 


The pulse transfer function Y(z)/R(z) becomes 


Y(z) _ 1 0.64z — 0.512 _ G 
R( z-12z-0.52 z-056 model 


The designed model matching control system has the block diagram as shown in Figure 
7-28(a). This block diagram can be simplified to those shown in Figures 7-28(b) 
and (c). 


(a) 


(b) 


0.642 - 0.512 
(z? - 1.22 + 0.52)z - 0.6) 


(c) 


Figure 7-28 (a) Block diagram of the designed model matching control system; (b) and 
(c) simplified block diagrams. 
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As stated earlier, Gasaa Hi(z) must be physically realizable. The degree of the 
numerator polynomial Gmoaeı Hi(z) must be equal to or less than the degree of the 
denominator polynomial of Gmoae: Hi(z). This means that for 

Y(z)  B(z) mth-degree polynomial in z 
U(z) A(z) nth-degree monic polynomial in z 


where A(z) and B(z) have no common factors, and 


B,,(z)  m'th-degree polynomial in z 
A,(z)  n'th-degree polynomial in z 


Gmode = 


we must have 
n'-m'zn-m 


If this condition is not satisfied, the best approach is to modify Gmoae so that this 
condition can be satisfied and the present approach can be used. 


PROBLEMS 


Problem B-7-1 
Consider polynomials A(z) and B(z) defined by 
A(z) = 27 + az + a = (z — à)(z — Ag) = z? — (Ay + À3z + AA 
B(z) = bız + b; = b(z — As) = bz — bài 
where b = b,. Define the Sylvester matrix E by 


a2 0 b; 0 
.|d4 à bi b 
E=] a0 b 
0 1 00 


Show that the determinant of E can be given by 
[E| = b°(A, ~ As)(A2 — As) 
Problem B-7-2 
Consider the following Diophantine equation: 
a(z)A(z) + B(z)B(z) = 1 
where 
A(z) = 27 -0.7z + 0.1 
B(z) = z? + 0.2z — 0.24 
a(z) = aoz + œ 
B(z) = Boz + Bı 


Solve this Diophantine equation for e(z) and B(z) and determine coefficients ao, a1, 


Bo, and fi. 
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Problem B-7-3 
Consider the plant Y(z)/U(z), where 
Y(z) B(z) 
UG) A(z) 


Assume that A(z) is an nth-degree monic polynomial in z and B(z) is an mth-degree 

polynomial in z. Assume also that there are no common factors between A(z) and B(z); 

that is, the plant is completely state controllable and completely observable. 
Consider the following Diophantine equation: 


Y(z)AG) + B(z)BG) = F(2)[A(z) - AG)] 


where H(z) is the desired characteristic polynomial for the pole placement part and 
F(z) is the desired characteristic polynomial for the minimum-order observer. [H(z) 
is an nth-degree monic polynomial and F(z) is an (n — 1)th-degree polynomial.] 

Show that if this Diophantine equation is solved for B(z) and y(z), then the 
use of 


U(z) = - Xu) = PO Ye) 


will accomplish the desired observed-state feedback regulator system. 


Problem B-7-4 


In Example 7-3 a control system was designed such that the desired characteristic 
equation for the pole placement part was 


H(z) = (z — 0.6 — j0.4)(z — 0.6 + j0.4) = z? — 1.2z + 0.52 
and the desired characteristic polynomial for the minimum-order observer was 
F(z) =z 


The Diophantine equation given by Equation (7-13) was solved. a(z) and B(z) were 
determined as follows: 


a(z) = z + 0.32 
B(z) = 24z - 16 


The constant Ko was determined as 8. Figure 7-6(a) shows the designed system. 
Show that the control signal u(k) can be given by 


u(k) = —0.32u(k — 1) - 24y(k) + 16y(k — 1) + 8r(k), k-1,2,3,... 
u(0) = —24y(0) + 8r(0) 
Plot u(k) versus k when the input r(k) is a unit-step sequence. 


Problem B-7-5 
Consider a plant defined by 
x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) 
where 


0 0 
1], H-|0, c=1 0 o0 
0 1 
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The pulse transfer function for the plant can be written as 
Y(z) _ B(z) 
U(z) A(z) 
Determine polynomials A(z) and B(z). 
Using the polynomial equations approach, design a control system for the plant. 


It is desired that the block diagram configuration of the designed system is the same 
as that of Figure 7-4. In solving the Diophantine equation 


a(z)A(z) + B(z)B(z) = F(z)H(z) 
assume that H(z) and F(z) are, respectively, as follows: 
H(z)= z7, F(z)=2? 


Obtain the unit-step response and unit-ramp response of the designed control system. 
The sampling period T is 1 sec. 


Problem B-7—6 


Consider the same plant as given in Problem B—7-5. Using the polynomial equations 
approach, design a control system for the plant. Use the block diagram configuration 
shown in Figure 7-5. Assume the following H(z) and F(z): 


H(z)=27, F(z) =27 


Obtain the unit-step response and unit-ramp response of the designed control system. 
Assume the sampling period T to be 1 sec. 


Problem B-7-7 
Consider the plant defined by 
x(k + 1) = Gx(k) + Hu(k) 


y(k) = Cx(k) 
where 
0 0 -025 1 
G-|1 0 0 $ H =] 0], C=[1 0 Q 
0 1 0.5 1 


Design a control system for the plant. For the pole placement part, we want to have 
three closed-loop poles at the origin, or 


H(z) = 2? 
and for the characteristic equation for the minimum-order observer, we want to have 
F(z) = z? 
Use the polynomial equations approach to the design. 
Problem B-7-8 
Consider the plant defined by 


Y(z) _ 0.6z + 0.5 
U(z  (z-1y 


Chap. 7 Problems 565 


Using the polynomial equations approach, design a control system such that the system 
will behave like the following model, G modei: 


22 -1 


Godel = 2 
z 


Obtain the unit-step response and unit-ramp response of the designed system (which 
is the same as Gmoaci). The sampling period T is 1 sec. 


Problem B-7-9 
Consider the plant defined by 
Y(z)  0.01873(z + 0.9356) 
U(z) (z — 1)(z — 0.8187) 


Using the polynomial equations approach, design a control system such that the system 
will behave like the following model, Gyoaei: 


0.32 
z? — 1.2z + 0.52 


Obtain the unit-step response and unit-ramp response of the control system (which is 
the same as the model, Gmoaei). The sampling period T is 0.2 sec. 


G modei = 


8 


Quadratic Optimal 
Control Systems 


8-1 INTRODUCTION 


Problems of optimal control have received a great deal of attention from control 
engineers. An optimal control system—a system whose design “optimizes” (mini- 
mizes or maximizes, as the case may be) the value of a function chosen as the 
performance index— differs from an ideal one in that the former is the best attainable 
in the presence of physical constraints, whereas the latter may well be an unattain- 
able goal. 


Performance Indexes. In designing an optimal control system or optimal 
regulator system, we need to find a rule for determining the present control decision, 
subject to certain constraints, so as to minimize some measure of the deviation from 
ideal behavior. That measure is usually provided by the chosen performance index, 
which is a function whose value we consider to be an indication of how well the actual 
performance of the system matches the desired performance. In most cases, the 
behavior of a system is optimized by choosing the control vector u(k) in such a way 
that the performance index is minimized (or maximized, depending on the nature 
of the performance index chosen). The selection of an appropriate performance 
index is important, because, to a large degree, it determines the nature of the 
resulting optimal control system. That is, whether the resulting control system will 
be linear, nonlinear, stationary, or time-varying will depend on the form of the 
performance index. The control engineer thus formulates this index on the basis of 
the requirements the system must meet and takes it into account in determining the 
nature of the resulting system. The requirements of the design usually include not 
only performance specifications, but also, to ensure physical realizability, restric- 
tions on the form of control to be used. 
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The optimization process not only should provide optimal control laws and 
parameter configurations, but should also predict the degradation in performance 
due to any departure of the performance index function from its minimum (or 
maximum) value that results when nonoptimal control laws are applied. 

Choosing the most appropriate performance index for a given problem is very 
difficult, especially in complex systems. To a considerable degree, the use of opti- 
mization theory in system design has been hampered by the conflict between analyt- 
ical feasibility and practical utility in the selection of the performance index. It is 
desirable that the criteria for optimal control originate not from a mathematical but 
from an application point of view. In general, however, the choice of a performance 
index involves a compromise between a meaningful evaluation of system perfor- 
mance and a tractable mathematical problem. 


Formulation of Optimization Problems. The problem of optimization of a 
control system may be formulated if the following information is given: 


1. System equations 

2. Class of allowable control vectors 
3. Constraints on the problem 

4. Performance index 

S. System parameters 


The solution of an optimal control problem is to determine the optimal control vector 
u(k) within the class of allowable control vectors. This vector u(k) depends on 


. The nature of the performance index 
. The nature of the constraints 

. The initial state or initial output 

. The desired state or desired output 


A oW) rd = 


Except for special cases, the optimal control problem may be so complicated for an 
analytical solution that a computational solution has to be obtained. 


Questions Concerning the Existence of Solutions to Optimal Control Problems. 
It has been stated that the optimal control problem, given any initial state x(0), 
consists of finding an allowable control vector u(k) that transfers the state to the 
desired region of the state space and for which the performance index is minimized. 

It is important to mention that in some cases a particular combination of plant, 
desired state, performance index, and constraints makes optimal control impossible. 
This is a matter of requiring performance beyond the physical capabilities of the 
system. 

Questions regarding the existence of an optimal control vector are important, 
since they serve to inform the designer whether or not optimal control is possible 
for a given system and given set of constraints. Two of the most important among 
these questions are those of controllability and observability, which were presented 
in Chapter 6. 
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Comments on Optimal Control Systems. The system whose design minimizes 
(or maximizes) the selected performance index is, by definition, optimal. Itis evident 
that the performance index, in reality, determines the configuration of the system. 
It is very important to point out that a control system that is optimal under one 
performance index is, in general, not optimal under other performance indexes. In 
addition, hardware realization of a particular optimal control law may be quite 
difficult and expensive. Hence, it may be pointless to devote too much expense to 
implementing an optimal controller that is the best only in some narrow, individu- 
alistic sense. A control system is seldom designed to perform a single task that is 
completely specified beforehand. Instead, it is designed to perform a task selected 
at random from a complete repertoire of possible tasks. In practical systems, then, 
it may be more sensible to seek approximate optimal control laws that are not rigidly 
tied to a single performance index. 

Strictly speaking, we should realize that a mathematically obtained optimal 
control system gives, in most practical situations, the highest possible performance 
under the given performance index and is more a measuring stick than a practical 
goal. Therefore, before we decide whether to build an optimal control system or 
something inferior but simpler, we should carefully evaluate a measure of the degree 
to which the performance of the complex, optimal control system exceeds that of 
a simpler, suboptimal one. Unless it can be justified, we should not build an 
extremely complicated and expensive optimal control system. 

Once the ultimate degree of performance is found by use of optimal control 
theory, we should make efforts to design a simple system that is close to optimal. 
Keeping this in mind, we build a prototype physical system, test it, and modify it 
until a satisfactory system is obtained that has performance characteristics close to 
the optimal control system we have worked out in theory. 

Analytically solvable optimal control problems provide good insight into opti- 
mal structures and algorithms that may be applied to practical cases. An example 
of analytically solvable optimal control problems is the problem of optimal control 
of linear systems based on quadratic performance indexes. Quadratic performance 
indexes have been used very frequently in practical control systems as measures of 
system performance. 


Quadratic Optimal Control. Let us consider the control system defined by 


x(k + 1) = Gx(k) + Hu(k) 
where 
x(k) = state vector (n-vector) 


u(k) = control vector (r-vector) 
G =n X n matrix 
H =n X r matrix 
In the quadratic optimal control problem we desire to determine a law for the control 
vector u(k) such that a given quadratic performance index is minimized. 
An example of a quadratic performance index is 


N-1 


J = Fx*(N)Sx(N) + ; 2 I* 0) Qx(K) + u*(k)Ru(k)] 
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where matrices S and Q are positive definite or positive semidefinite Hermitian 
matrices and R is a positive definite Hermitian matrix. The first term on the 
right-hand side of this last equation accounts for the importance of the final state. 
The first term in the summation brackets accounts for the relative importance of the 
error during the control process, and the second term accounts for the expenditure 
of the energy of the control signals. We assume that the control vector u(x) is 
unconstrained. 
It will be shown in Section 8-2 that the optimal control law is given by 


u(k) = -K(k)x(k) 


where K(k) is a time-varying r X n matrix. If N = o, then K(k) becomes a constant 
r X n matrix. The design of optimal control systems based on such quadratic perfor- 
mance indexes boils down to the determination of matrix K(K). 

The major characteristic of the optimal control law based on a quadratic 
performance index is that it is a linear function of the state vector x(k). Such a state 
feedback requires that all state variables be available for feedback. It is advan- 
tageous, therefore, to represent the system in terms of measurable state variables. 
If not all state variables can be measured, we need to estimate or observe the 
unmeasurable state variables. We then use the measured and observed state vari- 
ables to generate optimal control signals. 

The advantage of using the quadratic optimal control scheme is that the system 
designed will be asymptotically stable, except very special academic cases. (See 
Problems A-8-6 and A-8-7.) 

There are many different approaches to the solution of quadratic optimal 
control problems. In this chapter, we present a commonly used approach based on 
the minimization technique using Lagrange multipliers. For the steady-state 
quadratic optimal control problem, we also present the Liapunov approach. It will 
be shown in Section 8-3 that there is a direct relationship between Liapunov 
functions and quadratic performance indexes. 

Note that when an optimal control system is designed in state space it is 
important to check the frequency-response characteristics. Sometimes a specific 
compensation for noise effects may be needed. Then it may become necessary to 
modify the optimal configuration and accept a suboptimal configuration, or it may 
become necessary to modify the performance index. 


Outline of the Chapter. Section 8-1 has presented introductory material. 
Section 8-2 presents a basic quadratic optimal control problem and its solution. 
Section 8-3 treats the steady-state quadratic optimal control problem. Here we 
include the Liapunov approach to the solution of the quadratic optimal control 
problem. Section 8-4 discusses the quadratic optimal control of a servo system. 


8-2 QUADRATIC OPTIMAL CONTROL 


Quadratic optimal control problems can be solved by many different approaches. 
In this section we shall solve the basic quadratic optimal control problem by the 
conventional minimization method using Lagrange multipliers. 
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Quadratic Optimal Control Problem. The quadratic optimal control problem 
may be stated as follows. Given a linear discrete-time control system 


x(k + 1) = Gx(k) + Hu(k), x(0) =e (8-1) 
where it is assumed to be completely state controllable and where 
x(k) = state vector (n-vector) 
u(k) = control vector (r-vector) 
G =n X n nonsingular matrix 
H = n X r matrix 


find the optimal control sequence u(0), u(1), u(2),...,u(N — 1) that minimizes a 
quadratic performance index. An example of the quadratic performance indexes for 
a finite time process (0 = k = N) is 


ja 5x*(N)Sx(N) + FS oot + u*(k)Ru(k)] (8-2) 


where 
Q = n X n positive definite or positive semidefinite 
Hermitian matrix (or real symmetric matrix) 


R =r X r positive definite Hermitian matrix (or real 
symmetric matrix) 


S =n X n positive definite or positive semidefinite 
Hermitian matrix (or real symmetric matrix) 


Matrices Q, R, and S are selected to weigh the relative importance of the perfor- 
mance measures caused by the state vector x(k) (k = 0,1,2,..., N — 1), the control 
vector u(k) (k = 0,1,2,..., N — 1), and the final state x(N), respectively. 

The initial state of the system is at some arbitrary state x(0) — c. The final state 
x(N) may be fixed, in which case the term }x*(N)Sx(N) is removed from the 
performance index of Equation (8-2) and instead the terminal condition x(N) — x, 
is imposed, where x, is the fixed terminal state. If the final state x(N) is not fixed, 
then the first term in Equation (8-2) represents the weight of the performance 
measure due to the final state. Note that in the minimization problem the inclusion 
of the term 3x*(N)Sx(N) in the performance index J implies that we desire the final 
state x(N) to be as close to the origin as possible. 


Solution by the Conventional Minimization Method Using Lagrange Multipliers. 
The quadratic optimal control problem is a minimization problem involving a func- 
tion of several variables. Thus, it can be solved by the conventional minimization 
method. The minimization problem subjected to equality constraints may be solved 
by adjoining the constraints to the function to be minimized by use of Lagrange 
multipliers. 

In the present optimization problem, we minimize J as given by Equation 
(8—2), repeated here, 
1 1 
J= 2X (N)Sx(N) + 22. [x*(k)Qx(k) + u*(k)Ru(k)] (8-3) 
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when it is subjected to the constraint equation specified by Equation (8-1), 


x(k + 1) = Gx(k) + Hu(k) (8-4) 
where k = 0,1,2,..., N — 1, and where the initial condition on the state vector is 
specified as 

x(0) = c (8-5) 


Now, by using a set of Lagrange multipliers A(1), A(2), . . . , A(N), we define a new 
performance index L as follows: 


= Jo*(SstN) + 5 È (E) Qx() + w*GORu(O] 


+ A*(k + 1)[Gx(k) + Hu(k) — x(k + 1)] 
+ [Gx(k) + Hu(k) — x(k + 1)]*A(k + 1) (8-6) 


The reason for writing the terms involving the Lagrange multiplier in the form shown 
in Equation (8-6) is to ensure that L = L*. (L is a real scalar quantity.) Note that 


A*(0)[c — x(0)] + [c — x(0)]*AO) 


may be added to the performance index L. However, we shall not do so, to simplify 
the presentation. It is a well-known fact that minimization of the function L defined 
by Equation (8-6) is equivalent to minimization of J as defined by Equation (8-3) 
when it is subjected to the equality constraint defined by Equation (8-4). 

To minimize the function L, we need to differentiate L with respect to each 
component of vectors x(k), u(k), and A(k) and set the results equal to zero. From 
the computational viewpoint, however, it is convenient to differentiate L with 
respect to x,(k), i; (k), and A,(k), where x;(k), i, (k), and A,(k) are, respectively, the 
complex conjugates of x;(k), u;(k), and A,(k). (Note that the signal and its complex 
conjugate contain the same mathematical information.) Thus, we set 


oL 

= j= 1,2,...,n;k =1,2,...,N 
auus o he a eui 
oL B 3 
Xd 9 ET ork = OLN 1 
oL _ 3 Ta 
ze TEE A 


These equations are necessary conditions for L to have a minimum. Note that the 
simplified expressions for the preceding partial derivative equations are 


ðL —— H 

jx) 06, k=1,2,...,N (8-7) 
ôL " B 

Ju) 9, %k=0,1,...,N-1 (8-8) 

CUBE ieu) k =1,2,...,N (8-9) 
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Referring to Appendix A (see Problems A-7 and A-8) for partial differ- 
entiation of complex quadratic and bilinear forms with respect to vector variables, 
we have 


2 * = 2 * = 
aE Ax = Ax and ax* Ay = Ay 
Then, Equations (8-7), (8-8), and (8-9) may be obtained as follows: 


oL _ 
ORK) 
aL — 
àx(N) 
aL _ 
otk) | 
oL — 
àA(k) | 


Equation (8-13) is simply the system state equation. Equation (8-11) specifies the 
final value of the Lagrange multiplier. Note that the Lagrange multiplier A(k) is 
often called a covector or adjoint vector. 

Now we shall simplify the equations just obtained. From Equation (8-10) we 
have 


0:  Qx(k)*G*A(k-1-AXKk)-20, k-12,..,N-1 (8-10) 


0: Sx(N) — A(N) = 0, (8-11) 


0: Ru(k) + H*A(k *1) 20, k=0,1,...,N-1 (8-12) 


0: Gx(k — 1) + Hu(k -1)—x(k)=0, k=1,2,...,N (8-13) 


A(k) = Qx(k) + Gk +1),  k-21,2,3,...,N -1 (8-14) 


with the final condition A(N) = Sx(N). By solving Equation (8-12) for u(k) and 
noting that R^! exists, we obtain 


u(k) = -R"H*Mk +1)  k-0,,2,...,N -1 (8-15) 
Equation (8-13) can be rewritten as 
x(k + 1) = Gx(k) + Hu(k), k-20,12,...,N-1 (8-16) 


which is simply the state equation. Substitution of Equation (8-15) into Equation 
(8-16) results in 


x(k + 1) = Gx(k) — HR™H*A(k + 1) (8-17) 


with the initial condition x(0) = c. 

To obtain the solution to the minimization problem, we need to solve 
Equations (8-14) and (8-17) simultaneously. Notice that for the system equation, 
Equation (8-16), the initial condition x(0) is specified, while for the Lagrange 
multiplier equation, Equation (8-14), the final condition A(N) is specified. Thus, the 
problem here becomes a two-point boundary-value problem. 

If the two-point boundary-value problem is solved, then the optimal values for 
the state vector and Lagrange multiplier vector may be determined and the optimal 
control vector u(k) may be obtained in the open-loop form. However, if we employ 
the Riccati transformation, the optimal control vector u(k) can be obtained in the 
following closed-loop, or feedback, form: 
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u(k) = —K(k)x(k) 


where K(k) is the r X n feedback matrix. 

In what follows, we shall obtain the optimal control vector u(k) in the closed- 
loop form by first obtaining the Riccati equation. Assume that A(x) can be written 
in the following form: 


A(k) = P(k)x(k) (8-18) 


where P(k) is an n x n Hermitian matrix (or an n X n real symmetric matrix). 
Substitution of Equation (8-18) into Equation (8-14) results in 


P(k)x(k) = Qx(k) + G*P(k + 1)x(k + 1) (8-19) 
and substitution of Equation (8-18) into Equation (8-17) gives 
x(k + 1) = Gx(k) - HR H*P(k + 1)x(k + 1) (8-20) 


Notice that Equations (8-19) and (8-20) do not involve A(k) and thus we have 
eliminated A(k). The transformation process employed here is called the Riccati 
transformation. It is of extreme importance in solving such a two-point boundary- 
value problem. 

From Equation (8-20) we have 


[I + HR H*P(k + 1)]x(k + 1) = Gx(k) (8-21) 


For completely state controllable systems, it can be shown that P(k + 1) is positive 
definite or positive semidefinite. For at least a positive semidefinite matrix P(k + 1), 
we have 


IL, + HR H*P(k + 1)| = |I, + H*P(k + 1)HR™| = [L + R'H*P(k + 1)H| 
= [R!||R + H*P(k + 1)H| 2 0 
where we have used the relationship 
lI, + AB| = |I, + BA, A=n xr matrix, B =r x n matrix 


(See Appendix A.) Hence, the inverse of I + HR™'H*P(k + 1) exists. Conse- 
quently, Equation (8-21) can be written as follows: 


x(k + 1) = [E + HR H*P(k + 1)| ! Gx(k) (8-22) 
By substituting Equation (8-22) into Equation (8-19), we obtain 
P(k)x(k) = Qx(k) + G*P(k + D[I + HR! H*P(k + 1)| ! Gx(k) 
or 
{P(k) ~ Q — G*P(k + 1)[1 + HR! H*P(k + 1)| G}x(k) = 0 
This last equation must hold for all x(k). Hence, we must have 
P(k) = Q + G*P(k + 1)[I + HR H*P(k + D]'!G (8-23) 
Equation (8-23) may be modified. By using the matrix inversion lemma 


(A + BD)! = A"! — A^ B(I + DAB) DA"! 
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and making the substitutions 

A-L  B-HR', D-H*R(k-1) 
we obtain 

[I + HR H*P(k + 1]! = I - HR + H*P(k + 1)HR7]|" H*P(K + 1) 
=I - H[R + H*P(k + 1)H| ! H*P(k + 1) 
Hence, Equation (8-23) can be modified to 
P(k) = Q + G*P(k + 1)G 

— G*P(k + 1)H[R + H*P(k + 1)H] ! H*P(k + 1)G (8-24) 
Equation (8-24) or its equivalent [such as Equation (8-23)] is called the Riccati 
equation. Referring to Equations (8-11) and (8-18), notice that at k = N we have 

P(N)x(N) = A(N) = Sx(N) 
or 
P(N) =S (8-25) 


Hence, Equation (8—23) or (8-24) can be solved uniquely backward from k = N to 
k = 0. That is, we can obtain P(N), P(N — 1),...,P(0) starting from P(N), which 
is known. 

By referring to Equations (8-14) and (8-18), the optimal control vector u(k), 
given by Equation (8-15), now becomes 


u(k) = -R"H*A(k + 1) = -R H*(G*)"'[A(k) — Qx(k)] 
= -R'H*(G*) '[F(k) - Q]x(k) = —K(k)x(k) (8-26) 
where 
K(k) = R' H*(G*) '[F() — Q] (8-27) 


Equation (8-26) gives the closed-loop form, or feedback form, for the optimal 
control vector u(k). Notice that the optimal control vector is proportional to the state 
vector. 


Note that the optimal control vector u(k) can be given in a few different forms. 
Referring to Equations (8-18) and (8-22), u(k) may be given by 


u(k) = -R^ H*A(k + 1) = -R H*P(k + 1)x(k + 1) 

-R^H*P(K + D[I + HR H*P(k  1)]! Gx(k) 
-R^H*[P-(k + 1) + HR! H*]-! Gx(k) 

—K(k)x(k) (8-28) 


where 
K(k) = R! H*«P(k 1) + HR'H*|'G (8-29) 


A slightly different form of the optimal control vector u(k) can be given by 
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u(k) = —[R + H*P(k + 1)H] ! H*P(k + 1)Gx(k) 
= -K(k)x(k) (8-30) 
where 
K(k) = [R + H*P(k + 1)H]| ! H*P(k + 1)G (8-31) 


The equivalence of the expressions for the optimal control vector u(k) given by 
Equations (8-26), (8-28), and (8-30) can be shown easily; see Problem A-8-1. 

Equation (8—26), (8-28), or (8-30) clearly indicates that the optimal control 
law requires feedback of the state vector with time-varying gain K(k). Figure 8-1 
shows the optimal control scheme of the regulator system based on the quadratic 
performance index. It is important to point out that a time-varying gain K(k) can 
be computed before the process begins, once the system state matrix G, control 
matrix H, and weighting matrices Q, R, and S are given. Consequently, K(k) can 
be precomputed off-line and stored for future use. Note that the initial state x(0) does 
not enter the computation for K(k). The optimal control vector u(k) at each stage 
can be determined immediately by premultiplying the state vector x(k) by —K(k). 

Note that a property of the feedback gain matrix K(k) is that it is almost 
constant, except near the end of the process at k — N. (See Example 8-1, which 
follows shortly, and Problem A-8-3.) 


Evaluation of the Minimum Performance Index. We shall next evaluate the 
minimum value of the performance index: 


minJ = min | 1s*(N)SxtN) + 15 [x*(k)Qx(k) + usu) 


Premultiplying both sides of Equation (8-19) by x*(k), we have 
x*(k)P(k)x(k) = x*(K)Qx(k) + x*(k)G*P(k + 1)x(k + 1) 


Precomputation 
of K(k) 


Figure 8-1 Optimal regulator system based on a quadratic performance index. 
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Substituting Equation (8-21) into this last equation, we obtain 
x*(k)P(k)x(k) = x*(k)Qx(k) + x*(k + D)[I- HR! H*P(& + 1)]*P(k + 1)x(k + 1) 
= x*(k)Qx(k) + x*(k  1)[I + P(k + 1)HR™'H*)P(k + 1)x(k + 1) 
Hence, 
x*(k)Qx(k) = x*(k)P(k)x(k) — x*(k + 1)P(k + 1)x(k + 1) 
— x*(k + 1)P(k + 1)HR™'H*P(k + 1)x(k * 1) (8-32) 
Also, from Equations (8-15) and (8-18) we have 
u(k) = -R H*P(k + 1)x(k + 1) 
Hence, 
u*(k)Ru(k) = [—x*(k + 1)P(k + DHR"!]R[-R ! H*P(k + 1)x(k + 1)] 
= x*(k + 1)P(k + DHR^! H*P(k + 1)x(k + 1) (8-33) 
By adding Equations (8-32) and (8-33), we have 
x*(k)Qx(k) + u*(k)Ru(k) = x*(k)P(k)x(k) — x*(k + 1)P(k + 1)x(k + 1) (8-34) 
By substituting Equation (8-34) into Equation (8-3), we obtain 


Jnn = 3 8(N)Sx(N) + 32, [e*QEPQOxQI) — x(k + DPC + 1x + 0) 


= 5 ¥*(N)Sx(N) + 5 £x*(0)P(0)x(0) — x*(1)P(1)x(1) + x*(1)P(1)x(1) 


— x*(2)P(2)x(2) + +++ + x*(N — 1)P(N — 1)x(N — 1) — x*(N)P(N)x(N)] 


= TY (N)SK(N) " 5x*(0)P(0)x(0) - ZX*(N)P(N)X(N) (8-35) 


Notice that from Equation (8-25) we have P(N) = S. Hence, Equation (8-35) 
becomes 


Ja = 5¥*(0)P(0)x(0) (8-36) 


Thus, the minimum value of the performance index J is given by Equation (8-36). 
It is a function of P(0) and the initial state x(0). 
Example 8-1 
Consider the discrete-time control system defined by 
x(k + 1) = 0.3679x(k) + 0.6321u(k), | x(0)— 1 


Determine the optimal control law to minimize the following performance index: 


T= FOO +3 È BEO + 
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Note that in this example S = 1, Q = 1, and R = 1. Also, determine the minimum 
value of the performance index J. 
Referring to Equation (8-23), we obtain P(k) as follows: 


P(k) = 1 + (0.3679)P(k + 1)[1 + (0.6321)(1)(0.6321)P(K + 1)] (0.3679) 
which can be simplified to 
P(k) = 1 + 0.1354P(Kk + 1)[1 + 0.3996P(k + 1)! 
The boundary condition for P(k) is specified by Equation (8-25), and in this example 
P(N) = P(10) = S =1 
We now compute P(k) backward from k = 9 to k = 0: 
P(9) = 1 + 0.1354 x 1(1 + 0.3996 x 1)! = 1.0967 
P(8) = 1 + 0.1354 x 1.0967(1 + 0.3996 x 1.0967) ' = 1.1032 
P(T) = 1 + 0.1354 x 1.1032(1 + 0.3996 x 1.1032)! = 1.1036 
P(6) = 1 + 0.1354 x 1.1036(1 + 0.3996 x 1.1037) ! = 1.1037 
P(k) = 1.1037, k — 5,4,3,2,1,0 


Notice that the values of P(x) rapidly approach the steady-state value. The steady-state 
value P, can be obtained from 


P, = 1 + 0.1354P,(1 + 0.3996P,,) ' 
or 
0.3996P2 + 0.4650P,, — 1 =0 
Solving this last equation for P, we have 
Ps = 1.1037 or  -2267 


Since P(k) must be positive, we find the steady-state value for P(k) to be 1.1037. 
The feedback gain K(k) can be computed from Equation (8—27): 


K(k) = (1)(0.6321)(0.3679) "(P(k) — 1] = 1.7181(P(K) — 1] 
By substituting the values of P(k) we have obtained, we get 
K(10) = 1.7181(1 - 1) 2 0 
K(9) = 1.7181(1.0967 — 1) = 0.1662 
K(8) = 1.7181(1.1032 — 1) = 0.1773 
K(7) = 1.7181(1.1036 — 1) = 0.1781 
K(6) = K(5) = --- = K(0) = 0.1781 
The optimal control law is given by 
u(k) = —K(k)x(k) 
Since 


x(k + 1) = 0.3679x(k) + 0.6321u(k) = [0.3679 — 0.6321K(k)]x(k) 
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we obtain 
x(1) = [0.3679 — 0.6321K (0)]x (0) 
= (0.3679 — 0.6321 x 0.1781) x 1 = 0.2553 
x(2) = (0.3679 — 0.6321 x 0.1781) x 0.2553 = 0.0652 
x(3) = (0.3679 — 0.6321 x 0.1781) x 0.0652 = 0.0166 
x(4) = (0.3679 — 0.6321 x 0.1781) x 0.0166 = 0.00424 


The values of x(k) for k = 5,6,..., 10 approach zero rapidly. 
The optimal control sequence u(k) is now obtained as follows: 


u(0) = ~K(0)x(0) = —0.1781 x 1 = —0.1781 

u(1) = —K(1)x(1) = —0.1781 x 0.2553 = —0.0455 
u(2) = —K(2)x(2) = —0.1781 x 0.0652 = —0.0116 
u(3) = —K(3)x(3) = —0.1781 x 0.0166 = —0.00296 
u(4) = —K(4)x(4) = —0.1781 x 0.00424 = —0.000756 
u(k) *0, k=5,6,...,10 


The values of P(k), K(k), x(k), and u(k) are plotted in Figure 8-2. Notice that 
the values of P(k) and K(k) are constant except for the final few stages. 

Finally, the minimum value of the performance index J can be obtained from 
Equation (8—36): 


Jan = 5x" (0)POx(0) = ja x 1.1037 x 1) = 0.5518 


P(k) 


10$ 9990909009096 


x(k) 


0 2 4 6 8 10 k 


Figure 8-2 Plots of P(x) versus k, x(k) versus k, K(k) versus k, and u(k) versus 
k for the system considered in Example 8-1. 
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MATLAB approach to the solution of this example problem. A MATLAB 
program can be easily written for the solution of this example problem. MATLAB 
Program 8-1 shows a possible program. [Here, we used Equation (8—24) for the 
computation of P(k).] 


MATLAB Program 8-1 


G = 0.3679; H = 0.6321; Q= R= h S= t; x0 = 1; 
N = 11; p(N) = S; x) = T; Pnext =$; 


fori = N-1:-1:1, 
P = Q+G'*Pnext*#G—G'«Pnext#H#inv(R+H'*Pnext*H)*H'*Pnext*G; 
pti) = P; Pnext = P; 
end 
foris Newt, 
K = inv(R*H'rinv(G)s(pti) - Q); 
ki = K; 
end . 
fori = L:N-1, 
xnext = (G~H#k())*x(i); 
x+ T) =xnext: 
end 
fori = EN, 
uli) = —k(i)*x(i); 
end 


To print out the values of PO, P1,...,P10 [which correspond to p(1), p(2),..., 
p(11)], KO,K1,...,K10 [which correspond to k(1), k(2),...,k(11)], x0, x1,..., x10 
[which correspond to x(1), x(2),...,x(11)], and u0, u1,...,u10 [which correspond to 
u(1), u(2),..., u(11)], we enter the printout statement as follows. 


% ***** Printout P, K, x, and u ***** 


M = [p’ k 


M= 


0.1781 1.0000 
0.1781 0.2553 
0.1781 0.0652 
0.1781 0.0166 
0.1781 0.0042 
0.1781 0.0011 
0.1781 0.0003 
0.1781 0.0001 
0.1773 0.0000 
0.1662 0.0000 

0 0.0000 
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The first column of matrix M gives from top to bottom the values of PO, P1,..., P10. 
Similarly, the second, third, and fourth columns give KO, K1,..., K10; x0, x1,. .., x10; 
and u0O, u1,..., u10; respectively. 


Discretized Quadratic Optimal Control Problem. We shall next consider the 
quadratic optimal control of a discretized control system. Consider the continuous- 
time control system 


X = Ax + Bu (8-37) 
where 
u(t) = u(kT), kT x t € (k +1)T 


and the performance index to be minimized is 
t 
J = FUSC) + 2 | peto Qx() + u*CORu()] d (8-38) 
[U 


Suppose the continuous-time control system is approximated by its discrete equiv- 
alent. The discretized system equation is 


x((k + 1)T) = G(D)x(kT) + H(T)u(kT) 
and the discretized performance index when t, = NT will become as follows: 
J= 5x*(NT)Sx*(NT) 
N-1 


z» [x*(kT)Q; x(kT) + 2x*(kT)M, u(kT) + u*(kT)R,u(kT) ^ — (8-39) 


It is noted that the integral term in Equation (8-38) is not replaced by 


N-1 


52 [x*(& T)Qx(kT) + u*(kT)Ru(kT)] 


but is modified to include a cross term involving x(kT) and u(kT). Also, matrices 
Q and R are modified. In what follows, we shall consider the discretized quadratic 
optimal control problem by use of a simple example. 

Consider the continuous-time system defined by 


X(t) = ax(t) + bu(t) (8—40) 
where a and b are constants and 
u(t) = u(kT), kT St<(k+1)T 


The performance index to be minimized is 


J= ZX(NT) + ; f "ioro + Ru?(t)]dt (8-41) 
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Let us discretize the system equation and the performance index and formulate the 
discretized quadratic optimal control problem. 
Equation (8-40) may be discretized as follows: 


x((k + 1)T) = G(T)x(kT) + H(D)u(kT) 
where 
G(T) = e 
H(T) = J ebar - b (ert - 1) 
or 


x((k + 1)T) = e"x(kT) + b (er - 1)u(kT) (8-42) 


The performance index J given by Equation (8—41) may be discretized. First, rewrite 
J as 


1 173 renr 
R= ANT) +i | [oso + RWW] ae 
2 2 so SRT 
Noting that the solution x(t) for kT = t < (k + 1)T can be written as 
t 
x(t) = ex (KT) + Í e**-? bu(r) dv 
kT 


= (t — kT)x(kT) + n(t — kT)u(kT) 
where 
élt — kT) = e*n 


n(t - kT) = f Et - bdr = 2 jern - 1] 
kT a 
the performance index J, can be written as follows: 
1 1N (k+1)T 
A= 5x(NT) +5 | {Ole - KTKT) + n6 - kun 
k=0 “kT 
+ Ru?(kT)} dt 
1 1 (k*1)T 
= =x?(NT) += > Í [QE (t — kT)x’ (kT) 
2 Pm 


+20&(t — kT) n(t — kT)x(kT)u(kT) 
+ Qn'(t — kT)uXkT) + Ru*(kT)] dt 


- SXNT) + lY [Qix (kT) + 2Mix(kT)u(kT) + Ryw(kT)] — (8-43) 
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where 
(k+1)T 
Q= | 'or«-kna 
kT 
(k+)T 
M, = Í Qé&(t — kT)n(t - kT)dt 
kT 


(k* DT 
R, = Í [Qn (t — kT) + R]dt 
kT 


Notice that Q,, Mı, and R, may be simplified as follows: 


_ er 2alt-kT) dg = Q aT] 44 
Q= j o Q de = X (eT — 1) (8-44) 
(eH)T 
M, = Í Qe«-in? [e^ *P — 1]ar = bO (eat ~ 1Y (8-45) 
kT a 2a 
(k & ))T b ? 
R = Í DH - | * r| dt 
kT a 
- DO (uar - 3)(eT — 1) + 2aT] + RT (8-46) 
2a? J 


Summarizing, the present discretized quadratic optimal control problem may 
be stated as follows. Given the discretized system equation 


x((k + 1)T) = G(T)x(kT) + H(T)u(kT) 
where 


G(T) 2e" and  H(T) = qer -1) 


find the optimal control sequence u(0), u(T),...,u((N — 1)T) such that the follow- 
ing performance index is minimized: 
N-1 


J = BAT) + E (Quer) + 2M 3(6Tu(ET) + Ra ET) 


Such a performance index including a cross term involving x(kT) and u(kT) can be 
modified to a form that does not include a cross term, and the solution to the 
discretized quadratic optimal control problem can then be obtained in a manner 
similar to that for the quadratic optimal control problem presented earlier in this 
section. This subject is presented in the following. 


Performance Index Including a Cross Term Involving x(k) and u(k). Next, we 
shall consider the quadratic optimal control problem where the system is as given 
by Equation (8-1), which was 


x(k + 1) = Gx(k) + Hu(k), x(0) = c 


and the performance index is given by 
N-1 


J- Zx*(N)Sx(N) + ; D [x*(K)Qx(K) + 2x*(k)Mu(k) + u*(k)Ru(k)] (8-47) 
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where Q and S are n X n positive definite or positive semidefinite Hermitian ma- 
trices, Risanr x r positive definite Hermitian matrix, and Misanz X r matrix such 


that matrix 
Lie R 
M* R 
is positive definite. This means that 
bed) woe. m xD | 
= x*(k)Qx(k) + x*(k)Mu(k)  u*(k)M*x(k)  u*(k)Ru(k) 


= x*(k)Qx(k) + 2x*(k)Mu(k) + u*(k)Ru(k) 


is positive definite. Note that the performance index J given by Equation (8—47) 
includes a cross term involving x(k) and u(k). 
To obtain the optimal control vector u(k), let us define 


Q-Q-MR^"M* (8-48) 
and eliminate Q from the performance index J. Then Equation (8—47) becomes 
N-1 
Je T (N)SK(N) * 1X (EÂ + MR M*}x(&) 
k=0 


+ 2x*(k)Mu(k) + u*(k)Ru(k)} 

> JX*(N)Sx(N) + » [x*(k)Ox(k) + x*(k)MR" M*x(k) 
+ 2x*(k)Mu(k) + u*(k)Ru(k)] 

= 5x*(N)Sx(N) + LY OA) 


+ [x*(K)MR™ + u*(k)]R[R ! M*x(k) + u(k)] (8—49) 
Define 
v(k) = R M*x(k) + u(k) (8-50) 


Then Equation (8—49) can be written as follows: 
N-1 
z 5x*(N)Sx(N) + ; Y. [x*()Ox(k) + v*(k)Rv()] (8-51) 
k=0 


Notice that Equation (8-51) no longer involves the cross term. We have effectively 
eliminated the cross term involving x(k) and u(k). 

By substituting Equation (8—50) into the system equation, Equation (8-1), we 
obtain 


x(k + 1) = Gx(k) + H[v(k) - R! M*x(K)] 
= (G - HR! M9)x(k) + Hv(k) 
= Gx(k) + Hv(k) (8-52) 
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where 
G-G-HR'M* (8-53) 


Note that the quadratic optimal control of the system given by Equation (8-1) with 
the performance index given by Equation (8-47) is equivalent to the quadratic 
optimal control of the system given by Equation (8—52) with the performance index 
given by Equation (8-51). Hence, the optimal control vector v(x) that minimizes the 
performance index given by Equation (8-51) can be given as follows. Referring to 
Equation (8—26), (8-28), or (8-30), we have 


v(k) = -R H*(G*)" [P(k) — Q]x(K) (8-54) 

or 
v(k) = -R H*[P-(k + 1) + HR? H*]! Gx(k) (8-55) 

or 
v(k) = —[R + H*P(k  1)H] ! H*P(k + 1)Gx(k) (8-56) 


where P(k) is a modified version of Equation (8-23), or 
P(k) = Ô + G*P(k + DI + HR! H*Ê(k + D]'G, BIN) =S (8-57) 
The optimal control vector u(k) can then be given by 
u(k) = v(k) - R M*x(k) (8-58) 


where v(k) is given by Equation (8-54), (8—55), or (8-56). Whichever expression for 
v(k) is used, Equation (8-58) may be reduced to the following form: 


u(k) = -[R + H*P(k  1)H] [H*P(k + 1)G + M*]x(k) (8-59) 
(See Problem A-8~2 for details.) 
Example 8-2 
Consider the continuous-time control system 
X(t) = —x(t) + u(t) =. x (0) = 1 (8-60) 
where 
u(t) = u(kT), kT St<(k +1)T 


J x Q 1 ) Í [x (1) u (t ] dt 8 61 


where T = 1 sec and N = 10. Discretize the system equation and the performance 
index. Then determine the optimal control sequence u(KT) for k = 0,1,2,...,9; this 
will be the control sequence for which the performance index is minimum. Also, obtain 
the minimum value of J. 

Referring to Equations (8—40) and (8—42), the discretized system equation is 


x((k + 1)T) = e" x(kT) + 2 er — 1)u(kT) 
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where a = —1, b = 1, and T = 1. Thus, the system equation becomes 
x(k + 1) = 0.3679x(k) + 0.6321u(K), x(0) 21 (8-62) 
The discretized performance index becomes 
1 1 N-1 
h= z7 (N) + 2 > [Qix (k) + 2M, x(k)u(k) + Riw(k)] (8-63) 
k=0 


where Q,, Mı, and R; are given by substituting Q = 1 and R = 1 into Equations (8-44), 
(8-45), and (8—46), respectively, as follows: 


ES 2aT __ Ee ik -2 = 
Qs = Z (6 = 1) = (€? - 1) = 0.4323 


EN aT _ 2_1 -1 422 
M: = zz" - 17 = 5 (e™ - 17 = 0.1998 


2 
R= Zer - 3e" - 1) + 2aT] + T 


3 Xu (e — 3)(e* — 1) - 2] + 1 = 1.1681 
Thus, the performance index given by Equation (8-63) can be written as follows: 
9 
A- 2x00) + D [0.4323x^(k) + 0.3996x(k)u(k) + 1.1681u7(k)] (8-64) 
k=0 


Therefore, our problem becomes as follows. Given the system equation, Equation 
(8-62), find the optimal control sequence u(k), where k = 0,1,2,...,9, such that the 
performance index given by Equation (8—64) is minimum. 

Now, comparing Equations (8—47) and (8-64), we have 


S=1, Q = 0.4323, M = 0.1998, R = 1.1681 
Notice that 


~ 10.1998 1.1681 


Q M| {0.4323 0.1998 
M* R 


is positive definite. The next step is to modify J, as given by Equation (8-64) into the 
form given by Equation (8-51). Since Q = Q — MR^' M* = 0.3981, 


9 
h= 2x00) + D [0.3981x?(k) + 1.1681v(k)] (8-65) 
k=0 


The optimal control signal u(k) can be found from Equation (8-58): 
u(k) = v(k) - R"! M*x(k) 
which can be written in the form given by Equation (8-59): 
u(k) = —[R + H*P(k + 1)H] '[H*B(k + 1)G + M*]x(k) (8-66) 
where 


G = 0.3679 and H = 0.6321 


Equation (8—66) can be rewritten as follows: 
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u(k) = —[1.1681 + 0.3996P(k + 1)]-![0.2325P(k + 1) + 0.1998]x(k) 
0.2325P(k + 1) + 0.1998 
= EN —— x(k) = — K(k) x(k -67 
1.1681 + 0.3996P(k + 1) 9 (OR) (9-85 
where 


0.2325P(k + 1) + 0.1998 
1.1681 + 0.3996P(k + 1) 
Note that P(k) is as given by Equation (8-57), or 
P(k) = Ô + G*P(k + D[1 + HR™H*P(k + D]! G (8-69) 
where P(N) = P(10) = 1 and 
Ô = Q - MR^! M* = 0.3981 
G = G — HR^! M* = 0.3679 — 0.1081 = 0.2598 
Equation (8-69) can be simplified into the following form: 
0.06750P(k +1) 
1 + 0.3421P(k + 1) 


We shail now compute P(k) with the boundary condition P(10) = 1. Using 
Equation (8-70), we find P(k) backward from k = 9 to k = 0. The results are tabu- 
lated in Table 8-1. Using the values of P(k) just obtained, we compute K(k) from 
Equation (8-68). The results are also shown in Table 8-1. Next, we compute x(k). By 
substituting Equation (8—67) into Equation (8-62) and eliminating u(k) from these two 
equations, we obtain 


K(k) = (8-68) 


P(k) = 0.3981 + (8-70) 


0.3035 


x(k + 1) = T7681 + 039968 (k + 1) 


x(k), x(0) =1 (8-71) 


TABLE 8-1 VALUES OF P(k), K(k), x(k), AND ulk) FOR THE 
SYSTEM CONSIDERED IN EXAMPLE 8-2 


DIENEN NN EIN 
DECEEEE NET 
sem pem [om [eo 
[sue oum [e [om 
De pem [om Lon 
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Starting with x(0) — 1, the values of x(k) can be computed from Equation (8-71) by 
using the values of P(k) already obtained. The computed results are shown in Table 
8-1. Once we get the values of K(k) and x(k), the optimal control signal u(k) can be 
obtained from Equation (8-67), or 


u(k) = —K(k)x(k) 


The results are also shown in Table 8-1. 
Finally, referring to Equation (8—36), the minimum value of J, can be obtained 
as follows: 


Ji, min = Z P(0)x"(0) x E X 0.4230 x 1? = 0.2115 


Comments. The approach presented here is useful in solving a problem of 
finite-time quadratic optimal control of continuous-time systems by means of 
computer simulation. Unless the given continuous-time quadratic performance in- 
dex is rigidly specified for some reason, however, it is better to define a new 
discrete-time quadratic performance index after the system equations are dis- 
cretized. (See Section 8—4.) 

Note that in most cases matrices S, Q, and R in the performance index are not 
rigidly fixed, but are “in a sense" arbitrarily chosen positive definite (or positive 
semidefinite as the case may be) matrices; minimization of an arbitrarily chosen 
performance index does not have much meaning. As noted earlier, the main reason 
that the quadratic optimal control scheme is useful and frequently used is that it 
produces an asymptotically stable control system, except in very special academic 
cases. (See Problems A-8-6 and A-8-7.) 


8-3 STEADY-STATE QUADRATIC OPTIMAL CONTROL 


We have seen that when the control process is finite (when N is finite) the feedback 
gain matrix K(k) becomes a time-varying matrix. 

Let us now consider the quadratic optimal control problem where the process 
continues without bound, or where N = o (that is, where the process is an infinite- 
stage process). As N approaches infinity, the optimal control solution becomes a 
steady-state solution, and the time-varying gain matrix K(k) becomes a constant gain 
matrix. Such a constant gain matrix K(k) is called a steady-state gain matrix and is 
written as K. 

In what follows, we shall consider steady-state quadratic optimal control of a 
regulator system. The plant equation is given by 


x(k + 1) = Gx(k) + Hu(k) (8-72) 
For N = c, the performance index may be modified to 
J= » [x*(k)Qx(k) + u*(k)Ru(k)] (8-73) 
k=0 
The term }x*(N)Sx(N), which appeared in Equation (8-2), is not included in this 


representation of J. This is because, if the optimal regulator system is stable so that 
the value of J converges to a constant, x(~) becomes zero and ix*(e)Sx(o») = 0. 
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Let us now define the steady-state matrix P(k) as P. Referring to Equation 
(8—23), matrix P can be determined as follows: 
P-Q-G*P(I + HR! H*P)'! G 
= Q + G*(P^' + HR'H*)'!G (8—74) 


Clearly, matrix P is determined by matrices G, H, Q, and R. A slightly different 
expression for P can be derived from Equation (8-24): 


P = Q + G*PG — G*PH(R + H*PH) ! H*PG (8-75) 


The steady-state gain matrix K can be obtained in terms of P as follows. From 
Equation (8-27), 


K-R'H*(G*)'(P — Q) (8-76) 
From Equation (8-29), 

K-R'H*(P + HR!H*)''G (8—77) 

Still another expression for K is possible. From Equation (8-31), 
K = (R + H*PH)" H*PG (8-78) 

The optimal control law for steady-state operation is given by 
u(k) = —Kx(k) 

If, for example, Equation (8-78) is substituted into this last equation, we obtain 
u(k) = —(R + H*PH) ! H*PGx(k) (8-79) 


and the control system becomes an optimal regulator system: 
x(k + 1) = [G - H(R + H*PH) ! H*PG]x(k) 
= (I + HR™'H*P)' Gx(k) (8-80) 
where we have used the matrix inversion lemma, 
(A + BC)! = A? — A^! B(I + CA?! B)! CA 


with A = I, B = H, and C = R ! H*P. (Refer to Appendix A.) 
The performance index J associated with the steady-state optimal control law 
can be obtained from Equation (8-36) by substituting P for P(0): 


Inia = 33 (0) Px(0) (8-81) 


In many practical systems, instead of using a time-varying gain matrix K(k), 
we approximate such a gain matrix by the constant gain matrix K. Deviations from 
the optimal performance due to the approximation will appear only near the end of 
the control process. 


Steady-State Riccati Equation. In implementing the steady-state (or time- 
invariant) optimal controller, we require the steady-state solution of the Riccati 
equation. There are several ways to obtain the steady-state solution. 
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One way to solve the steady-state Riccati equation given by Equation (8-75), 
P = Q + G*PG — G*PH(R + H*PH)'! H*PG 


is to start with the following non-steady-state Riccati equation, which was given by 
Equation (8-24): 


P(k) = Q + G*P(k + 1)G 
— G*P(k + 1)H[R + H*P(k + 1)H] ! H*P(k + 1)G (8-82) 
By reversing the direction of time, we may modify Equation (8-82) to read 
P(k + 1) = Q + G*P(k)G — G*P(k)H[R + H*P(K)H]"' H*P(k)G (8-83) 


and begin the solution with P(0) = 0 and iterate the equation until a stationary 
solution is obtained. In computing the numerical solution, it is important to note that 
matrix P is either a Hermitian or a real symmetric matrix and is positive definite. 

In what follows, we shall first presenta MATLAB approach to the solution of 
steady-state quadratic optimal control problem. Then we discuss another approach 
based on the Liapunov method. 


MATLAB Approach to the Solution of Steady-State Quadratic Optimal Control 
Problem. In what follows we consider an example problem of steady-state 
quadratic optimal control of a regulator system and solve it with MATLAB. 

Consider the system 


x(k + 1) = Gx(k) + Hu(k) 


where 


The performance index J is given by 
lS ; 
J= 32 [x (&)Qx(k) + u'(k)Ru(k)] 
k=0 


where 


-|1 0 - 
o-[; I R=1 


The control law that minimizes J can be given by 
u(k) = —Kx(k) 


Determine the steady-state gain matrix K. 
MATLAB Program 8-2 solves this problem. Note that MATLAB carries out 
the iterative solution of 


P = Q + G'PG - G'PH(R + H'PH) H'PG 
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MATLAB en 8-2 


Io ~- Steady-state quadratic optimal control ---------- 


: 96 vean * Solving steady-state Riccati equation and finding 


% optimal feedback gain matrix K ***** 


ys tte Enter matrices G, H, Q, and R we 


G- [02 0;0 O4] 


Hell, A 


Q=[1 0:0 0.5); 


Rell) 


(ep roe Start with the solution of steady-state Riccati equation 
h% with P -[0 0;0 0] ***** 


2[0 0:0 a 


> = 8 +G'*PtG - G*P*H'ivRe HPPHPH P0; 


% ***** Check solution P every 10 or 20 steps of iteration. 
96 Stop iteration when P ' stays constant srmn ; 


onio e 
Pe Q- G'P*G- G"P'H'invReH*P*H)*H*PG 


end 


& Pa 


1.0252 0.0189 
-0.0189 0.5724 


: foris t: 10, : : 

LOPeQe G"P'G- C*P*H*inv(ReH'*PTH)HH'SPG; 
| end 
P 


1.0252 -0.0189 
-0.0189 0.5724 


D 9," ***** P matrix stays constant. Thus steady state has been 
98 reached. The steady-state P matrix is *****.— . 


Pe 


..1.0252 
-0.0189 
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% ***** Optimal feedback gain matrix K is obtained from ***»* 
K = inv(R + H'*P*H*FI*P*G 


0,0786 0.0865 


with the boundary condition 
_|0 0 
LE 
until the solution reaches steady state. Then MATLAB Program 8-2 computes the 
optimal feedback gain matrix K using the following equation: 
K = (R + H'PH)'! H'PG 

Liapunov Approach to the Solution of the Steady-State Quadratic Optimal Regu- 
lator Problem. In what follows we shall present the Liapunov approach to the 
solution of the parameter optimization problem and the steady-state quadratic 
optimal regulator problem. As we shall see, there is a direct relationship between 


Liapunov functions and quadratic performance indexes. 
Let us consider the system 


x(k + 1) = Gx(k) (8-84) 


where matrix G involves one or more adjustable parameters and all eigenvalues of 
G lie inside the unit circle, or the origin x = 0 is asymptotically stable. Let us assume 
that we desire to minimize the following performance index by adjusting the parame- 
ter (or parameters): 


J= LY (oo) (8-85) 


where Q is a positive definite or positive semidefinite Hermitian (or real symmetric) 
matrix. We shall show that a Liapunov function can be utilized for solving this 
problem. 

For the system of Equation (8-84), a Liapunov function may be given by 


V(x(k)) = x*(k)Px(k) 
where P is a positive definite Hermitian (or real symmetric) matrix and 
AV(x(k)) = V(x(k + 1)) — V(x(k)) 
= x*(k + 1)Px(k + 1) — x*(k)Px(k) 
Let us set 
x*(k)Qx(k) = —[x*(k + 1)Px(k + 1) — x*(k)Px(k)] (8-86) 


Notice that Equation (8-86) can be rewritten as follows: 


592 Quadratic Optimal Control Systems Chap. 8 


x*(k)Qx(k) = —{[Gx(k)]*P[Gx(k)] — x*(k)Px(k)} 
-x*(k)[G*PG — P]x(k) 


By the second method of Liapunov, we know that for a given matrix Q there exists 
a positive definite matrix P, since matrix G is stable, such that 


G*PG - P = -Q (8-87) 
Hence, we can determine the elements of P from this equation. 


The performance index J can be evaluated as follows: 


LD (0x0 = E È [MIP aC) — x(k  DPx + D] 


i 26 


J 


= 5x*(0)Px(0) (8-88) 


where P is a function of the adjustable parameter(s). In obtaining Equation (8-88) 
we used the condition that x(%)—> 0, since all eigenvalues of G lie inside the unit 
circle. Thus, the performance index J can be obtained in terms of the initial state 
x(0) and matrix P, which is related to matrices G and Q by Equation (8-87). 
Minimization of the performance index J can be accomplished by minimizing 
x*(0)Px(0) with respect to the parameter in question. 

It is important to note that the optimal value of the parameter depends, in 
general, upon the initial condition x(0). However, if x(0) involves only one nonzero 
component, for example, if x,(0) # Oand the other initial conditions are zero, then 
the optimal value of the parameter does not depend on the numerical value of x,(0). 


Liapunov Approach to the Solution of the Steady-State Quadratic Optimal Control 
Problem. We shall now consider the optimal control problem where, given the 
plant equation 


x(k + 1) = Gx(k) + Hu(k) (8-89) 
we wish to determine the matrix K of the optimal control law 
u(k) = —Kx(k) (8-90) 


such that the performance index 
J = Y [K*(K)Qx(k) + w*(G)Ru(O] (8-91) 
k=0 


is minimized, where Q is a positive definite or positive semidefinite Hermitian (or 
real symmetric) matrix and R is a positive definite Hermitian (or real symmetric) 
matrix. 


Substituting Equation (8-90) into Equation (8-89), we obtain 
x(k + 1) = Gx(k) — HKx(k) = (G — HK)x(k) (8-92) 
Substituting Equation (8-90) into Equation (8-91) yields 
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J= 5D lk) + x*(k)K*RKx(k)] 


= lY x*(k)(Q + K*RK)x(k) (8-93) 


In the following analysis, we assume that the matrix G — HK is stable, or that the 
eigenvalues of G — HK lie inside the unit circle. (If the system is completely state 
controllable and observable, it can be proved that G — HK is a stable matrix. Refer 
to Problem B-8-6.) Then a Liapunov function exists that is positive definite and 
whose derivative is negative definite. Following the discussion given in solving the 
parameter optimization problem, we set 


x*(k)(Q + K*RK)x(k) = —[x*(k + 1)Px(k + 1) — x*(k)Px(k)] (8-94) 
By referring to Equation (8-92), Equation (8-94) can be modified to 
x*(k)(Q + K*RK)x(k) = —[(G — HK)x(k)]*P[(G — HK)x(k)] + x*(k)Px(k) 
= —x*(k)[(G — HK)*P(G — HK) — P]x(k) (8-95) 


Comparing the two sides of Equation (8-95) and noting that this equation must hold 
true for any x(k), we require that 


Q + K*RK = -(G — HK)*P(G — HK) + P (8-96) 


Note that by the second method of Liapunov, for a stable matrix G — HK, there 
exists a positive definite matrix P that satisfies Equation (8-96). 
Equation (8-96) can be modified as follows: 


Q + K*RK + (G* - K*H*)P(G — HK) -P-0 
or 
Q + G*PG - P + K*(R + H*PH)K — (K*H*PG + G*PHK) = 0 
This last equation can further be modified as follows: 
Q + G*PG — P + [(R + H*PH)"K - (R + H*PH)" H*PG]|*. [(R + H*PH)!?K 
- (R + H*PH) "H*PG] - G*PH(R + H*PH)'H*PG - 0 (8-97) 


Matrix K that minimizes J can be obtained by minimizing the left-hand side of 
Equation (8-97) with respect to K. (See Problem A-8-5.) Since 


[(R + H*PH)'"K — (R + H*PH) '" H*PG]*[(R + H*PH)"K 
— (R + H*PH) " H*PG] 
is nonnegative, the minimum occurs when it is zero, or when 
(R + H*PH)’?K = (R + H*PH)  H*PG 
Hence, we obtain 
K = (R + H*PH)'! H*PG (8-98) 
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Substitution of Equation (8-98) into Equation (8-97) gives 
P = Q + G*PG — G*PH(R + H*PH)'! H*PG (8-99) 


Matrix P must satisfy Equation (8-99), which is the same as Equation (8-75). 
Equation (8-99) can be modified to read 


P = Q + G*P[I — H(I + R! H*PH)? R^! H*P]G (8-100) 
By use of the matrix inversion lemma 
(I + HR? H*P)'! = I - H(I + R'! H*PH)? R H*P 
Equation (8-100) may be modified to 
P = Q + G*P(I + HR! H*P)! G (8-101) 


Matrix P may be determined from Equation (8-101). 

Finally, the minimum value of J can be obtained as follows. Referring to 
Equations (8—93) and (8-94) and noting that x(o») = 0, we obtain the minimum value 
of the performance index J as follows: 


Jan 7 5 iX x*(k)(Q + K*RK)x(k) 
- -iXi [x#(k)Px(k) — x*(k + 1)Px(k + 1)] 
= 3x*(0)Px(0) 


Example 8-3 


Consider the system 


x(k + 1) 1 1 x(k) xi(0) _ 1 
E + 2 i E akg] 29 ~ H 


where —0.25 = a < 0. We desire to determine an optimal value of a that will minimize 
the following performance index: 


J =} x*()Ox(k) 
2 k=0 
where Q = I. 
From Equation (8-88), the performance index J in terms of the system parameter 
a is given by 


J= 5x*(0)Px(0) 


where P involves the system parameter a. We now determine P from Equation (8-87): 


G*PG — P= -Q 


1 a |[pu pi} 1 1. {pu Pr}. |1 0 
1 -1jpo paja -1 P Pr 0 1 


or 
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which can be simplified to 
| 2apı2z + à pn Pu + (a — 2)py - ul _ li J 
Pu + (a — 2)pi2 — apz; pu — 2pi2 0 -1 

This last equation results in the following three equations: 

2api2 + @ pn = -1 

Pu + (a — 2)py2 — apn = 0 
Pu — 2p = -1 

Solving these three equations for the p;;’s, we obtain 


1 + 0.540 0.5(a — 1) 
"a(1-0.5a) — a(1- 0.5a) 
05(a -1 .— 15 — 
a(1 + 0.5a) a(1 t 0.5a) 
Since —0.25 - a « 0, P is positive definite. 
The performance index J becomes 


P= 


1 1 Pu puo||1 1 
= = y* = = = >= 
773* 0x0) = 501 [s paj 0| 2?" 
_ __1+0.5a* 
2a(1 + 0.5a) 
The minimum of J occurs at the end point a = —0.25. Thus, the minimum value of J 
is found to be 
+ 0.5(—0.25)? 
Tinian = 1 + 0.5(7025) = 2.3571 


~ 2(=0.25)(1 — 0.5 x 0.25) 


Example 8-4 
Consider the system 


a(k +1)|_]|1 1] x(k) 1 (00)|. |1 
e + D] = |; TEA * Ho 20) = H 
and the performance index 
J- ix [x*(K)Qx(k) + u* (k)Ru(k)] 


where Q = I and R = 1. From Equation (8-98), the optimal control law that minimizes 
the performance index J is given by 
u(k) = —Kx(k) = -(R + H*PH) ' H*PGx(K) 
where matrix P may be obtained from Equation (8-101): 
P = Q + G*P(I + HR'H*P)!G (8-102) 


Let us determine matrix P for the present system. 


Noting that 
[1 1 
-fial 
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which is nonsingular, we may modify Equation (8-102) to read 
(P — QG^'(I + HR^! H*P) = G*P (8-103) 


Matrix P in this problem is a real symmetric matrix. Hence, Equation (8-103) can be 
written as follows: 


Pu pia 10 0 1 1 0 1 n pia _111 u pr 
(e zJ- [e Me S] e off peh- oz 
or 


(pz — 1)(1 + pn) (pz — 1)pi2 + pR- pz+t1 Pu pi 


This last equation yields four scalar equations. Note, however, that only three of them 
are linearly independent. The four scalar equations are as follows: 


| pil + pn) Po + pu -—1- pr | i p tpa pat Pa 


Poll + pu) = pu + pr 
Pin + pu — 1- pr = Prt pz 
(pa — 1)(1 + pu) = pu 
(pz — pom + pr- prt1=pr 


From the first of these four equations, we obtain 


pal (8-104) 
From the second of the four equations, we have 
Pz = pu 2 (8-105) 
Then the third of the four equations gives 
pu-3pu -3-0 (8-106) 


[By substituting Equations (8-104) and (8-105) into the last of the four equations, we 
find that it is always satisfied.] By solving Equation (8-106), we find 


Pu = 3.7913 or —0.7913 
Since matrix P must be positive definite, we choose pi; = 3.7913. Then 
Pz = pu — 2 = 3.7913 — 2 = 1.7913 
Consequently, matrix P is found to be as follows: 


p= 3.7913 1.0000 
1.0000 1.7913 


8-4 QUADRATIC OPTIMAL CONTROL OF A SERVO SYSTEM 


In this section we shall discuss quadratic optimal control of a servo system. The plant 
we consider here is the inverted pendulum system shown in Figure 8-3. We shall 
design a digital control scheme for this inverted pendulum control system. 

The inverted pendulum is unstable in that it may fall over any time in any 
direction unless a suitable control force is applied. Here we consider only a two- 
dimensional problem in which the pendulum moves only in the plane of the page. 
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Zh 


Figure 8-3 Inverted pendulum system. 


Assume that the pendulum mass is concentrated at the end of the rod, as shown in 
the figure. (The rod is massless.) The control force u is applied to the cart. 

It is desired to keep the inverted pendulum upright as much as possible and 
yet control the position of the cart, for instance, by moving the cart in a step fashion. 
To control the position of the cart, we need to build a type 1 servo system. The 
inverted-pendulum system mounted on a cart does not have an integrator. There- 
fore, we feed the position signal y (which indicates the position of the cart) back to 
the input and insert an integrator in the feed-forward path, as shown in Figure 8-4. 
(Note that other configurations are possible.) We choose the sampling period T to 
be 0.1 sec. 


Figure 8-4 Block diagram of servo system. 
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The control system to be designed here will include state feedback and an 
integrator in the closed loop. Design variables are gain constant K; and feedback gain 
matrix K. Therefore, designing the digital control scheme means determining con- 
stant K; and matrix K. We shall solve this design problem with MATLAB. We shall 
obtain the unit-step response of the designed system with MATLAB. 

In solving this design problem, we shall define state variables x;, x2, xs, and x, 
as follows: 


x,=6 
X = 
X3—7X 
X47X 


In this system we would like to keep angle 0 as small as possible when the cart is 
moved in the step fashion. We consider the displacement of the cart as the output 
of the system. Thus, the output equation becomes 


x 
= X2 
y-[0 0 1 0] i 
X4 
We shall assume the following numerical values for M, m, and l. 
M =2 kg, m = 0.1 kg, 1=0.5m 


In designing the control system, we shall use the discretized model. The 
discretized state and output equations for the plant can be derived as shown next. 
(Refer to Problem A-8-10 for the derivation of these equations.) 


x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) + Du(k) 


where 
11048 0.1035 0 0 —0.0051 
| 21316 1.1048 0 0 _ |-0.1035 E 7 
G-| pops -00001 101» B^| oooh C= 91% P= 1) 
—0.0508 -0.0025 0 1 0.0501 


From Figure 8-4 the state-space representation for the entire control system is 
given by 


x(k + 1) = Gx(k) + Hu(k) 
y(k) = €x(k) 
v(k) = v(k — 1) + r(k) — y(k) 
u(k) = —Kx(k) + K;v(k) 


where 
K= [k 1 ky ks ka] 
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Since 
v(k + 1) = v(k) + r(k + 1) — y(k * 1) 
= v(k) + r(k + 1) — C[Gx(k) + Hu(k)] 
= —CGx(k) + v(k) — CHu(k) + r(k + 1) 
we have 


xk -*1| | G 0|[ x(k) H 0 
ler + 5| = E d en * |-cnj^9 * |, pe * 0 
Let us assume that the input r is a step function, or 
r(k) 7» r(k * 1) 5r 


Then, as k approaches infinity, 
3)" [ee 13] -ako + [fo 


Xe(k) = x(k) — x(~) 
ve(k) = v(k) — v(~) 
Then the error equation becomes 


[s 28] -L8s EE uo 


Define 


Note that 
(E) = Kx) + Ks) = -IK -Kaf | 
Now define 
$-| &, ji &-| Bal: K-[K -K]  w(k) = u(k) 

xy (Kk) 
SES Olean 
TE 
Xse(k) 


where xse(k) = v.(k). Then we have 
E(k + 1) = GE(k) + Hw(k) 
w(k) = —K&(k) 


Itis noted that since the system is continuous time, a continuous-time quadratic 
performance index could be considered. However, discretization of the continuous- 
time quadratic performance index generates a cross term involving £ and w. (See 
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Section 8—3.) To simplify the design process, it is better to define a discrete-time 
quadratic performance index. Our problem, therefore, becomes that of determining 
matrix K such that the following quadratic performance index is minimized: 


= 15 grog + w'Rw] 


where Q and R should be chosen properly so that the response of the system is 
acceptable. (The purpose of using the quadratic performance index is to assure the 
stability of the system.) 

Let us choose Q and R as follows: 


100 000 
01 000 
Q=| 0 0 100 00|  Re-[I1] 
00 010 
00 001 


Our emphasis is on state variables x3, and x,,. (Note that many different sets of Q 
R may be used.) In the MATLAB program for solving this problem, we shall use 
the notations 

Gi-6, HI-H, KK=K 


MATLAB Program 8-3 yields the solution P of the steady-state Riccati equation, 
feedback gain matrix K, and integral gain constant K;. 


: MATLAB Program 8-3 


| 96 erem - Design of an inverted pendulum control system 
96 based on minimization of a quadratic performance index ---------- 


h% à "^^ The following program solves steady-state Riccati 
uation and gives optimal feedback gain matrix K ***** 


: ES 3 venen Enter matrices G, H, C, and D ***** 


one 0.1035 0 
= 24316 1.1048 0 
1 
0 


>% eee Enter matrices G1, H1, Q and R ***** 
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G1 = [G zeros(4,1)-C*G 1]: 
H1 = [H-C*H]; 


Q=[10 0 
U0 1 
0.0 
-00 
- 0.0 
R= [1]; 


0 
0 
0 
0 
0 


0 
Q 
0 
0 
un 


p, tens Stat pus steady-state Riccati equation 
% for P. with P = diag(o, atam 


P= diago, 4); 


P= Q+ci'Prcr - "rc PM 


% tene Check solution P every 20 steps of iteration. 
% Stop iteration when P stays constant ***** 


Pe = Q+G1"P*G1 - GT*P*HT*inv( RE HT'SP*HT)SHT'*P*CI; 


foris 1:20, 
end 
P 
Peg 
3.0e +003" 
9.6887 2.1677 
2.1677 0.4876 
34319 07743 
24341 0.5490 
0. 1741 -70.0393 
foris 1 :20, 
end. 
P 
P= 
1.0e 4 004 * 
1.0707. 0.2397 
0.2397. 0.0539 
0,3996 . 0.0902 
0.2772. -0.0625 
-0.0220 — -0.0050 
fori = 1:20, 


P2Q-GI"P*CI- G1'*P*H1*inv(R+H1'*P*H1)*H1'*P*G1; 


end 
P 


3.4319 
0.7743 
2.2988 
1.1788 
-0.1312 


0.3996 
0.0902 
0.2617 
0.1367 


:0:0158 


2.4341 
0.5490 
1.1788 
0:7824 
-0:0625 


0.2772 
0.0625 
0.1367 
0.0895 
-0.0078 


-0:1741 
-0.0393 
-0.1312 
-0.0625 

0.0185 


P=Q+G1"P*G1 - GU*P*HTrinv(Re Hi "P*HT)*HT'*P*GI; 


:0.0220 
-0.0050 
-0.0158 
-0.0078 

0:0021 
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P= 
1.0e + 004 * 
1.0724 0.2401 0.4006 0.2778 . -0.0221 
0.2401 0.0540 0.0904 0.0627 ` -0.0050 
0.4006 0.0904 0.2623 0.1371 -0.0158 
0.2778 0.0627 0.1371 . 0.0897 0.0078 
..-0.0221 -0.0050  -0.0158 0.0078 -0.0021 
e cs 
P = Q + GI*P*CI - GU*P*HT*inv(RHHTP*HTHTP*CI; 
end : Sem ER 
Po 
P= 
1.0e + 004 * j 
. 10724 0.2401 0.4006 02778  -00221 - 
0.2401 0.0540 0.0904 0.0627  -0.0050 
0.4006 0.0904 0.2623 0.1371 -0.0158 
0.2778 0.0627 0.1371 0.0897 -0.0078 
-0.0221 -0.0050  -0.0158 ` -0.0078 0.0021 


% ***#* P matrix stays constant. Thus steady state has 
- 96 been reached. The steady-state P matrix is ***** 


P 

e 

1.0e + 004 * 
1.0724 0.2401 0.4006 02778  -0.0221 
0.2401 0.0540 . 0.0904 0.0627 . -0.0050 
0.4006 0.0904 — 0.2623 0.1371 -0.0158 
0.2778 0.0627 0.1371. 0.0897 0.0078 
-0.0221 -0.0050 -0.0158 -0.0078 ^ 0.0021 

% ***** Optimal feedback gain matrix KK is obtained from ***** 

KK = inv(R  HT'*P*HT*HIT'*P*GI 

kka uo 

164.9346 -14.4819 -10.8475 -9.2871 0.5189 

K= [KK(1) KK(2) KK(3) KK(4)] 

K= 


-64.9346. -14.4819 -10.8475 -9.2871 
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KI = -KK(5) 


We thus determined feedback gain matrix K and integral gain constant K, as follows: 
K = [—64.9346 —14.4819 —10.8475 —9.2871], K; = —0.5189 


Our mathematical design is completed. 


Unit-Step Response of the Designed System. To obtain the unit-step response, 
we proceed as follows: Since 


x(k + 1) = Gx(k) + H[-Kx(K) + K,v(k)] 
= (G — HK)x(k) + HK; v(k) 
v(k + 1) = v(k) + r(k + 1) — y(k + 1) 
v(k) + r(k + 1) — C[Gx(k) + Hu(k)] 
(—CG + CHK)x(k) + (1 — CHK,)v(k) + r 


we obtain 
Be : D ` Bon 1 eea 7 H Fo elm 
»&) - Ic 0] | + toy (8-108) 
where r = 1. To determine the unit-step response y (k) (the cart position), first define 
aim oue 1 S] 


-[t 


CcC-[C 0]-[0 0 1 0 0] 
DD - [D] - [0] 


and then convert the state-space equations [Equations (8-107) and (8-108)] into the 
pulse transfer function Y(z)/R(z) by using the following MATLAB command: 


[num,den] = ss2tf(GG, HH,CC,DD) 


Then use the filter command: 
y = filter(num,den,r) 


where r = unit step input. 
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To obtain the response x;(k), we note that 


x(k)=[1 0 0 0 az] 


Define 
FF-[1 0 0 0 0] 
Then 


x(k) = abe (8-109) 


Convert the state-space equations [Equations (8-107) and (8—109)] into the pulse 
transfer function Xi(z)/R(z) using the command 


[num1,den1] = ss2tf(GG,HH,FF,DD) 
Then use the filter command 
x1 = filter(num1,dent1,r) 
Similarly, to obtain the response x,(k), we note that 


x(k)=[0 1 0 0 of | (8-110) 


Define 
Jj-[0 1 0 0 0] 


Then convert the state-space equations [Equations (8-107) and (8—110)] into the 
pulse transfer function X;(z /R(z) using the command 


[num2,den2] = ss2tf(GG,HH,JJ, DD) 
Then use the filter command 
x2 = filter(num2,den2,r) 


Similarly, by defining 
LL-[0 0 O 1 0] 
MM-[0 0 0 0 1] 


the responses x,(k) and xs(k) = v(k) can be obtained using the commands 


[num4,den4] = ss2tf(GG,HH,LL, DD) 
x4 = filter(num4,den4, r) 


and 
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[num5,den5] = ss2tf(GG, HH,MM,DD) 
x5 = filter(num5,den5, r) 


MATLAB Program 8-4 yields y(k), x(k), x(k), x4(k), and xs(k) when the unit-step 
input (r — 1) is given. 


_ MATLAB pt B-4 


% tren This pipi | à calculates the response id ins system 
-. 96 when subjected to a unit-step input. The values that are 
% used for K and KI are computed in MATLAB Program 8-3. The 
|. *h response is obtained using the method to convert the discrete- 


% nepos is then found with the conventional ‘filter command mme 


» gp tern Enter matrices K Kl, GG, HH, cr " JA LL, MM. DD waere 


% ett To obtain Woa convert state-space equations in into lo pulse 
% transfer function X3(z)yR(G) ***** 


Imam den] = s saco, HH, CC DD) 


9p tren Enter command to obtain unit-step response wes 


re ones, 101); 
axis([0 100. -0.2 1. 2); 
k=0;100; 
y=fi ternum den n 

i oe o' k y,'- T 


grid 

title('Position of Cart : y) = x39 
xlabel('k!) 

ylabel(y(k) = x3(k)') 


% ***** To obtain x1 (k) convert state-space equations into pulse 
% transfer function X1(z)/R(z) ***** 


[numt,dent] = ss2U(GG,HH,FF;DD); 


606 Quadratic Optimal Control Systems Chap. 8 


|| 9o ***** Enter command to obtain unit-step response ***** 
* axis([O- 100 -0.1 0.2]; 
_ x1 a filterinum], dent, n; 
: plottk,x1,'o' kx1,-!) 
: gid 
title Angular Displacement Theta : xt(k)) 
. Xlabel'k') 
: ylabelixt 09) 


-— % * senum To obtain od convert state-space equations into pulse 


: Winds = ss2tf(GG,HH,J}, DD); 


| % ***** Enter command to obtain unit-step response ***** 


%* wanes To y obtain x4(k) convert state-space equations into pulse 
% transfer function X4(z)/R(z) ***** 


[ [num4,den4] = ss2tf(GG,HH,LL,DD); 


| % = Enter command to obtain unit-step response ***** 


E sto 3 4 05. "n 
x rinu 


us ii To obtain x5(k) convert state-space equations into pulse 
_ 9 transfer function X5(z)/R(z) ***** 


. [num5,den5] = ss2tf(GG,HH,MM,DD); 
. 95 ***** Enter command to obtain unit-step response ***** 
 axis([O 100 -5 30]; 
x5 = filter(nums, den5,n; 
i Kd 1k. x5,'-9) 
('Output of Integrator : x5(k) = vi) 


t 
xlabel('k') 
ylabel('x5(k) = v(k)') 
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Based on MATLAB computations, the position of the cart [ y(k) versus k] can 
be obtained as shown in Figure 8-5. (Notice that the initial move of the cart is in 
the negative direction.) Figure 8-6 depicts the angular displacement of the pendu- 


Position of Cart : y(k) = x3(k) 


x3(k) 


y(k) = 


"o 10 20 30 40 50 60 70 80 90 100 
Figure 8-5 Plot of position of the cart y(k) versus k. 


Angular Displacement Theta : x1(k) 


0.2 


o 10 20 30 40 50 60 70 80 90 100 


Figure 8-6 Plot of angular displacement x;(&) versus k. 
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lum, x,(k) = 0(k), plotted versus k. Figure 8-7 shows the angular velocity of the 
pendulum, x,(k), plotted versus k. Figure 8—8 shows the velocity of the cart, x,(k), 
plotted versus k. The output of the integrator, v(k) versus k, is shown in Figure 8-9. 


Angular Velocity Theta Dot : x2(k) 


x2(k) 


0 10 20 30 40 50 60 70 80 90 100 


Figure 8-7 Plot of angular velocity x2(k) versus k. 


Velocity of Cart : x4(k) 


x4(k) 


0 10 20 30 40 50 60 70 80 90 100 
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Output of Integrator : x5(k) = v(k) 


fe TUTUP — Spe RE 


| 


Figure 8-9 Plot of output of integrator v(x) versus k. 


Since in the present system the sampling period T'is 0.1 sec, it takes approximately 
6 sec to reach steady state. 


EXAMPLE PROBLEMS AND SOLUTIONS 


Problem A-8-—1 
Consider the discrete-time control system 
x(k + 1) = Gx(k) + Hu(k) 
where 
x(k) = state vector (n-vector) 
u(k) = control vector (r-vector) 
G =n X n nonsingular matrix 
H = n x r matrix 
We wish to find the optimal control vector that will minimize the following performance 


index: 


J= Jx*(N)Sx(N) + 


tI 


D [x*(E)Qx(&) + u*(&)Ru(k)] 


where Q and S are n X n positive definite or positive semidefinite Hermitian matrices 
and R is an r X r positive definite Hermitian matrix. 
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In Section 8-2 we obtained the optimal control vector u(k) in the form given by 


Equation (8-26): 
u(k) = -R~ H*(G*)"'[P(X) - Q]x(k) 
where P(K) is given by Equations (8-23) and (8-25): 
P(k) = Q + G*P(k + D[I- HR' H*P(k + )]'G, P(N)=S 


1. Show that the optimal control vector u(k) can be modified to read 
u(k) = -R ^ H*[P '(k + 1) + HR! H*]'! Gx(k) 
where 
P(k)-2Q-G*[P'(k + 1) + HR'H*]''G,  P(N)-S 
2. Show that the optimal control vector u(k) can also be given by 
u(k) = -[R + H*P(k + 1)H] ' H*P(k + 1)Gx(k) 
where 
P(k) = Q + G*P(k + DG 
— G*P(k + 1)H[R + H*P(k + DH] 'H*P(k - 1)G, P(N) =S 


(8-111) 


(8-112) 


(8-113) 


(8-114) 


(8-115) 


(8-116) 


3. Show that the three different expressions for P(k) given by Equations (8-112), 


(8-114), and (8-116) are equivalent. 


Solution 


1. We shall first show that Equations (8-111) and (8-113) are equivalent. Referring 


to Equation (8-23), 


(G*) '[P(k) - Q] = (G*) " G*P(k + D[I + HR" H*P(k + 1]^G 


= P(k + 1)[I + HR! H*P(k + 1]! G 
-[P'(k-1-HR'H*]'"'G 


Hence, 


u(k) = -R^'H*(G*) "[P(k) — Q]x(&) 


= -R^ H*[P-(k + 1) + HR H*]' Gx(k) 


and we have shown that Equations (8-111) and (8-113) are equivalent. 


2. To show that Equations (8—113) and (8-115) are equivalent, note that 


[R + H*P(k + 1)H] ' H*P(k + D[P^'(k + 1) + HR'H*] 
— [R + H*P(k + 1)H] ! H*[I + P(k + D)HR ' H*] 
=(R + H*P(k + 1)H] [R + H*P(k + DH]R" H* 
=R 'H* 


Hence, 


R^ H*[P^'(k + 1) + HR? H*[" = [R + H*P(k + 2H] H*P(k + 1) 


and consequently 
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u(k) = -R^! H*[P(k + 1) + HR^! B*]! Gx(k) 
-[R + H*P(k + 1)H| ! H*P(k + 1)Gx(k) 


We have thus shown that Equations (8-113) and (8-115) are equivalent. 


3. Next, we shall prove that Equations (8-112) and (8-114) are equivalent. If we 
note that 


P(k + 1I + HR H*P(k + 1D]? = [P(k + 1) + HR! HH]! 


then the equivalence of Equations (8-112) and (8-114) is apparent. 
To show that Equations (8-114) and (8-116) are equivalent, notice that 


[P^ (k + 1) + HR^' H*JP(k 1) — P(k + 1)H[R + H*P(k + 1)H] ! H*P(k + 1) 

=I + HR^H*P(Kk + 1) - H[R + H*P(k + 1)H] ' H*P(k + 1) 

— HR H*P(k + 1)H[R + H*P(k + 1)H]! H*P(k + 1) 
-I- H(-R'! + [R + H*P(k + 1))H]" 

*R^H*P(k + 1)H[R + H*P(k + 1)H] H*P(k + 1) 
-I- H([I + R^ H*P(k + 1)H][R + H*P(k + 2H] — R“}H*P(k + 1) 
= I — H{R'[R + H*P(k  1)H][R + H*P(k + 2H] - R')H*P(k + 1) 
= I — HİR" - R`'JH*P(k + 1) =I 


Hence, 
[P (k + 1) + HR'H*]~' 
= P(k + 1) — P(k + 1)H[R + H*P(k + 1)H] ' H*F(k + 1) 
and we have 
P(k) = Q + G*[P (k + 1) + HR! H*]'G 
= Q + G*P(k + 1)G — G*P(k + 1)H[R + H*P(k + D)H| ! B*P(k + 1)G 
Thus, we have shown that Equations (8-114) and (8-116) are equivalent. 


Problem A-8—2 


For the quadratic optimal control problem where the system is as given by Equation 
(8-1) and the performance index is as given by Equation (8-47), we have found in 
Section 8-2 that the optimal control vector u(k) can be given by the equation 


u(k) = v(k) - R^! M*x(k) (8-117) 
where v(k) is given by Equation (8-54), (8-55), or (8-56) as follows: 
v(k) = -R` H*(G*)'[R(k) — Q]x(k) 

or 

v(k) = -R^ H*(P-'(k + 1) + HR H*]^ Gx(k) 
or 

v(k) = -[R + H*P(k + 1)H]! H*P(k + 1)Gx(k) (8-118) 
where 

P(k) = Ô + G*P(k + D[IT- HR HsP(k +1))'G,  PB(N)-S 
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and 
G-G-HR'M* and Q-Q-MR'M* 
Show that the optimal control vector u(k) can be expressed as follows: 
u(k) = —[R  H*P(k + 1)H] '[H*P(k + 1)G + M*]x(k) (8-119) 


Solution The equivalence of the right-hand sides of the three expressions for v(k) was 
shown in Problem A-8-1. Hence, we may derive Equation (8-119) using, for example, 
Equation (8-118). 

From Equations (8-117) and (8-118), we have 


u(k) = v(k) - R^! M*x(k) 

= —[R + H*P(k + 1)H]! H*P(k + 1)Gx(k) — R^! M*x(k) 
—{[R + H*P(k + 1)H]  H*P(k + D[G - HR M*] 
+[R + H*P(k  1)H]"[R + H*P(k + 1)H]R M*]x(k) 
= —[R + H*P(k + 1)H]'[H*P(k + 1)G — H*P(k + 1)HR^' M* 

+ M* + H*P(k + ))HR^ M*]x(K) 
= —[R + H*P(k  1)H] (H*P(k + 1)G + M*]x(k) 

which is Equation (8-119). 
Problem A-8-3 

Consider the discrete-time control system defined by 

x(k + 1) = Gx(k) + Hu(k) 


eg on 0- 


Determine the optimal control sequence u(k) that will minimize the following perfor- 
mance index: 


where 


J = jx )Sx(8) + 5D [et Ox(K) + u*QERIQO] 


_|{1 0 2 _]1 0 
aei rh seo i] 


Solution Referring to Equation (8-23), we have 
P(k) = Q + G*P(k + DI + HR ' H*F(k + D]|!G 


B È ‘| n " JEn +1) pulk + M 
JO 1 1 O]||pi(k-1) pa(k + 1) 


KI o], [1 o] pute +1) palk +1) [1 1 
0 1 0 Ol] pu(k +1) p(k +1) 1 0 
The boundary condition for P(k) is specified by Equation (8-25) and is given by 


P(N) = P(8) = S = |. 1 


where 
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Now we compute P(k) backward from P(7) to P(0): 


efa TLE f s t] 


SIL: alas esa 3 


12 $|_ | 3.4286 0.8571 
$ 2| | 0.8571 1.7143 
Similarly, P(5), P(4), . . . , P(0) can be computed as shown in Table 8-2. 


Next, we shall determine the feedback gain matrix K(k). Referring to Equation 
(8—27), matrix K(k) can be given as follows: 


K(k) = R^! B*(G*) "[P(k) — Q] 


-un of} i| ro-a 


TABLE 8-2 TABLE SHOWING P(k), K(k), x(k), AND u(k) FOR k = 0,1,2,...,8, 
RESPECTIVELY, FOR THE SYSTEM CONSIDERED IN PROBLEM A-8-3 


m 
3.7913 1.0000 1.0000 

| 10000 19513 | [1.0000 0.7913] [60006 | ~1.0000 
3.7911 0.9999 0.0000 

[r^ 17913 | [0.9999 0.7913] [* | -0.7913 
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11 k = 1 12 k 
=o T En otk) - | 
-[pw(k) pz(k)- 1] 
Thus, 
K(8) = [pu(8) p(8)— 1] = [0.0000 0.0000] 
K(7) = [px(7) p27) - 1] = [0.5000 0.5000] 


Similarly, K(6), K(5), . . . , K(0) can be computed to give the values shown in Table 8-2. 
Next, we shall compute x(k). Let us write 


K(k) = [k(k) k2(k)] 
Then 
x(k + 1) = Gx(k) + Hu(k) 
= [G - HK(k)}x(k) 


= | - kik) 1- e [09] 
1 0 x(k) 


o-i 


x(k), where k = 1,2,...,8, can be obtained as follows: 


xp = |171 1- 0.7913 |[1] _ [0.0000 
1 0 0| ~ | 1.0000 
x(2) = | 1 ~ 69999 1 — 0.7913 || 0.0000 | _ | 0.2087 
1 0 1.0000 | ~ | 0.0000 


Similarly, x(3), x(4), . . . , x(8) can be computed. The results are shown in Table 8-2. 
Finally, the optimal control sequence u(k) can be obtained from Equation 
(8-28): 


Since the initial state is 


u(k) = —K(k)x(k) 
That is, 


u(0) = -K(0)x(0) = —[1 EUH - —1.0000 


u(1) = —K(1)x(1) = —[0.9999 EUH = -0.7913 


Similarly, u(2), u(3), . . . , u(8) can be computed to give the values shown in Table 8-2. 
As mentioned earlier, the feedback gain matrix K(k) is constant except for the 

last several values of k. This means that if the number of stages is not 8 but 100 then 

K(0), K(1), . . . , K(93) will be constant matrices and K(94), K(95), . . . , K(100) will vary. 

This fact is important, because if the number of stages N is sufficiently large, then the 

feedback gain matrix becomes a constant matrix and so the designer is able to use a 

constant feedback gain matrix to approximate the time-varying optimal gain matrix. 
The minimum value of J is obtained from Equation (8—36), as follows: 


ED 


1 1 
Jis = 5X*(0)P(0)x(0) = 5 [1 af ous 1.7913 || 0 


= 1.8956 
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Problem A-8-4 


Referring to Problem A-8-3, solve that problem with MATLAB. Write a MATLAB 
program for finding P(k), K(k), x(k), and u(k). Print out P(k), K(k), x(k), and u(k). 


Solution MATLAB Program 8-5 shows a possible program for solving the problem. 


MATLAB Program 8 8-5 


[e pea optimal control -——— 


fori New] 


[o xM 
| end 
| fori = 1:N, 


tend 


x und and finding optimal feedback 


y ce Enter matrices sG; H, s, „Q; and R***** 


Gat a oho 

L gen "0:0 ak US 
Qan 00 1h 
Re 


J, eene Ene x0 = (1: Ol, N= 9, p MN) = 1, p12(N) = 


— x d =i, “ue ET pee = 0, Pnext = S eee 


P= oo ee Prext)*G; 


pes = a n. pl 2) = = n 2); pes = P(2,2); Pnext = P; 
, en ; 


| % erre Optimal feedback gain matrix K is obtained from ***** 


K = inviR RH sinviGe(ipt 6) pl20),p120) -p220]—QX 
Kit = K(1); k. ü = Ne: 


end | 
h str Optimal control uti) is obtained from ***** 


dr S ANC eb 


xnext = (6-Hlk1) khe bat 3x20; 
xt(1); x2 FED = anato; 


uli) = = Tko XA) bct x20); 


= 0; Pnext = 


S; 
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Using this program, matrix P, matrix K, vector x, and vector u can be obtained as shown 
next. 


% ***** Printout P, K, x, and u ***** 


P = [p11;p12;p12;p22] 


Columns 1 through 7 
3.7913 3.7911 3.7877 
1.0000 0.9999 0.9986 
1.0000 0.9999 0.9986 
1.7913 1.7913 1.7905 
Columns 8 through 9 
2.5000 1.0000 
0.5000 
0.5000 
1.5000 


K = [kt;k2]' 


x = [x1;x2] 


x= 


Columns 1 through 7 


1.0000 0.0000 0.2087 0.0001 0.0437 0.0003 0.0099 
0 1.0000 0.0000 0.2087 0.0001 0.0437 0.0003 
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Columns 8 through 9 


0.0015 0.0057 
0.0099 0.0015 


In this printout, PO, P1,..., P8 are given as column vectors. The first column of matrix 
P gives PO, the second column gives P1, and so forth. In each column the first row gives 
p11, the second and third row give p12, and the fourth row gives p22. KO, K1,..., K8 
are given as row vectors in matrix K. The first row corresponds to KO and the last row 


corresponds to K8. xO, x1,...,x8 are given as columns of matrix x. The first column 
corresponds to x0 and the last column corresponds to x8. u0, u1, ..., u8 are given as 
the first, second, . . . , ninth row of vector u. 
Problem A-8-5 

Consider the scalar control system 

x(k + 1) = gx(k) + hu(k) (8-120) 
and the performance index 

J= i Y [qx (k) + ru?(k)] (8-121) 

k=0 


where q > 0 and r > 0. It was shown in Section 8-3 that the optimal control law that 
will minimize the performance index J can be given by 


u(k) = —Kx(k) (8-122) 
Substituting Equation (8-122) into Equation (8-120), we obtain 
x(k + 1) = (g — hK)x(k) (8-123) 


By substituting Equation (8-122) into Equation (8-121), we have 
12lX (qe ck 
2 k=0 


Using the Liapunov approach and referring to Equation (8-94), we set 
(q + rK?)*(k) = —[px?(k + 1) — px?(k)] (8-124) 
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By substituting Equation (8-123) into Equation (8-124), we obtain 
(q + rK’)x*(k) = [7p( — hKY + p]x'(k) 

or 

lg + rK? + p(g — hK? — p]x'(k) = 0 
This last equation must hold true for any x(k). Hence, we require that 

q + rK? + p(g —hKyY - p =0 (8-125) 
Show that the optimal control law can be given by 
u(k) = —Kx(k) = —ghp(r + ph) ' x(k) 


or 
K = ghp(r + ph’) (8-126) 
Also show that p can be determined as a positive root of the following equation: 
q-ptgrp(r + ph’) * =0 (8-127) 


Solution By referring to Equation (8—88), the performance index J can be given as 
follows: 


J - ip (0) 
To minimize this value of J for a given x(0) with respect to K, we set 


Jp 

dK 0 
where p is as given by Equation (8-125). Notice that in Equation (8-125) q + rK? > 0. 
Hence, 1 — (g — kK)? + 0. Therefore, p can be given as follows: 


q + rK? 


By differentiating p with respect to K and equating the result to zero, we obtain 
dp 2rK[i- (g — hAKy]- (q + rK)[2(g - hK)h] _ 


(8-128) 


aK [| — @ - hK? 0 
which yields 
rK[1 — (g — RKy] - (q + rK’\(g - hK)h = 0 
Hence, we obtain 
q*rK& _ rK _ 
1-(gp-hK) hg- hK) (8-130) 
From Equations (8-129) and (8-130), we get 
rK 
p= ig — AK) (8-131) 
Solving Equation (8-131) for K and noting that r + ph? > 0, we have 
- gh _ 21-1 _ 
K T4 phi ghp(r + ph^) (8-132) 


which is Equation (8-126). 
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By substituting Equation (8-132) into Equation (8—125), 
242,2 2 
hpr je |) -p 
q+ FEES + pfp) p=0 
which can be simplified to 
q-p*grp(r*ph)'-0 
which is Equation (8-127). 


The same results can also be obtained in the following way. First note that 
Equation (8-125) can be modified as follows: 


q + (r + ph?)K? — 2ghpK + pg? - p 20 
Or 
2 4/ 2 ghp ? gh’ p? 
qtpg-p- CO pH 7r p TS n (8-133) 


Then, considering this last equation as a function of K, the minimum of the left-hand 
side of this last equation with respect to K occurs when 


Vit pk - SR =0 
V1 + ph? 
or 
K = ghp(r + ph’) (8-134) 


which is Equation (8-126). 
By substituting Equation (8-134) into Equation (8-133), we obtain 


g^ h^ 2 


"rep 


q *pg'-p 
which can be simplified as follows: 


q-p*grpr*ph)'-0 
which is Equation (8-127). 


Problem A-8—6 
Consider the system defined by 


e + 2 _ E EH Rs + B 
x(k + 1) 0 1.5 || x2(k) 0 
Show that this system cannot be stabilized by the state feedback control scheme: 
u(k) = -Kx(k) 
whatever matrix K is chosen. 
Solution Define 
K = [k, kı] 
Then 


_[-0.5 -os| |1 _ | -0.5 - k, -0.5 - 0.5k; 
s-nk-[ 0 os Hz =| 0 1.5 | 
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Hence, the characteristic equation becomes 


z+0.5+k_ 0.5-0.55k, 
0 z-1.5 


=(z+0.5+ k)(z — 1.5) 20 
The closed-loop poles are located at 
z= -0.5 - ki, z=1.5 


Since the pole at z = 1.5 is located outside the unit circle, the system is unstable, 
whatever K matrix is chosen. Hence, the quadratic optimal control technique cannot 
be applied to this system. (The solution to the quadratic optimal control problem does 
not exist.) 


lzI- G + HK| = 


Problem A-8-7 


Consider the system 
(k +1)| [0 Of! x(k) 1 (0|. | 1 
EE + Hl E E lA i Hr? Ea z H (E135) 
and the performance index 
J= 15 [x*(K)Qx(k) + u*(k)Ru(k)] (8-136) 
where 


.|1 0 _ 
e-|; al Rec 


Determine the optimal control law to minimize the performance index. Also, 
determine the minimum value of J. 


Solution From Equation (8-135) we have 
[0 0 | |1 
gaia one] 
Matrix P can be determined from Equation (8-101), or 


P-Q-G*P(I + HR H*P)'G (8-137) 


Since matrices Q, G, H, and R are real, matrix P is a real symmetric matrix. By 
substituting given matrices Q, G, H, and R into Equation (8-137), we obtain 


mes ard P Loa In 
Pi2 Po 0 0 0 1 Pi2 Pz 0 1 
-1 
1 pu Piz 0 0 
+ 1 
B, | rn) F 1 
Simplifying this last equation, we get 


pu pu|. 1 0 + 1 Pi2 P22 || "Po —Pi2 
Pr po 0 0 1+ pul Pi2 p2l|}l+pu l*pu 
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or 


Pull + pn) po + pu)| |1-*pu 0 
Pull + pu) Phl + pir) 0 0 


ES -Pi + pz(1 + pn) -pi + p(l + pn) 
=P + poll + pu) ~p + p(l + pu) 


This last equation is equivalent to the following three equations: 
Pull + pu) = 1+ pu — Ph + pz(1 + pu) 
poll + pu) = -pi + pall + pu) 
Pal + pu) = -piz + pa(1 + pu) 
Solving these three equations for pu, pi;, and pz, requiring that pi; > 0, we obtain 
Pu =1, Po = 0, P2 =90 


Hence 


1 0 
P=; j| (8-138) 


Equation (8-138) gives the required solution of the steady-state Riccati equation. 
Referring to Equation (8-79), we have 


u(k) = -(R + H*PH)^' H*PGx(k) 


-( 1)" [1 al aR to 


-27[0 O]x(k) = 0 (8-139) 


Equation (8-139) gives the optimal control law. 
The closed-loop system now becomes 


x(k + 1) = Gx(k) + Hu(k) = f JE (8-140) 


Equation (8-140) gives the optimal closed-loop operation for the system. The closed- 
loop poles are at yw, = 1 and 4; = 0. The closed-loop system is not asymptotically 
stable. 

The minimum value of J is obtained from Equation (8-81), as follows: 


m= peoo -in v Sli- 


Although the system is not asymptotically stable, the performance index becomes finite 
and is minimum. In fact, since u(k) = 0 for k = 0,1,2,..., the system equation 
becomes 


x(k+1)=0 
x(k + 1) = xi(k) + x(k) 
or 
xi(0) = 1, x(k) = 0, k = 1,2,3,... 
x,(0)=1, x(k) =2, k=1,2,3,... 


622 Quadratic Optimal Control Systems Chap. 8 


Notice that the performance index becomes finite, because it involves x(k}, but does 
not include x2(k). 

This example problem has shown that in an academic but not practical case, the 
quadratic optimal control does not yield an asymptotically stable system. 


Problem A-8-8 


If an nth-order linear single-input-single-output discrete-time control system is com- 
pletely state controllable, we need at most n sampling periods to bring an arbitrary 
initial state to the desired final state, provided the control vector is not constrained. 
Hence, if we allow N (where N n) sampling periods, then we have extra freedom to 
satisfy additional constraints. 

The amount of control energy needed depends on the time period (number of 
sampling periods) allowed for control. If the number of sampling periods allowed is n, 
the order of the system, then the time-optimal control sequence u(0),u(1),..., 
u(n — 1) is unique. However, if N sampling periods (N > n) are allowed, then more 
than one control sequence is possible. Each possible control sequence requires a certain 
amount of control energy. In many industrial applications, if many control sequences 
are possible, it is desirable to accomplish control tasks using the minimum amount of 
control energy. 

In this problem, we treat the problem of transferring the state from an arbitrary 
initial state to the desired final state (which we assume to be the origin of the state space) 
in N sampling periods and at the same time using the minimum control energy. 

Consider the discrete-time control system defined by 


x(k + 1) = Gx(k) + Hu(k) (8-141) 
where 
X(K) = state vector (n-vector) at kth sampling instant 
u(k) = control signal (scalar) at kth sampling instant 
G =n X n nonsingular matrix 
H =n x 1 matrix 


Determine the control law that will bring the system state from an arbitrary initial 
state to the origin in N sampling periods (where N > n) using a minimum amount of 
control energy, where the control energy is measured by 


1 N-1 
22 w(k) 
2 k=0 
Assume that the system is completely state controllable. 
Solution Referring to Equation (5-30), the state x(N) of Equation (8-141) can be 
given by 
x(N) = G"x(0) + G"' Hu(0) + G"?Hu(1) + --- + GHu(N —2) + Hu(N - 1) 
Substituting 0 for x(N) in this last equation yields 
x(0) = -G^Hu(0) - G^Hu(1) - --- -G""Hu(N -2) - G"Hu(N — 1) (8-142) 
Define 
f£ = G'H (8-143) 
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Then Equation (8-142) becomes 
x(0) = —f,u(0) — £.u(1) — -> — fy-1u(N — 2) — fyu(N — 1) (8-144) 


Since the system is completely state controllable, the vectors fi, f;, . . . , f, are linearly 
independent. (The remaining N — n vectors can be expressed as linear combinations 
of these n linearly independent vectors.) Equation (8-144) can be rewritten as 


x(0) = -FU (8-145) 
where 
u(0) 
F=([Kifi- if], u=| "O 
u(N - 1) 


We shall now find the control sequence that satisfies Equation (8—145) and at the same 
time minimizes the total control energy. Note that matrix F is an n x N matrix and has 
rank n. Since F is not a square matrix, the inverse of matrix F is not defined. Notice 
that since N > n the number of unknown control signals u(0), u(1),...,u(N — 1) in 
Equation (8-145) is greater than the number n of component scalar equations. A set 
of scalar equations in such a situation is said to be underdetermined and possesses an 
indefinite number of solutions. However, in the present case we have a constraint that 
a set of N unknown variables u(0), u(1), ... , u(N — 1) gives a minimum norm: 


1 N-1 
= > wk) = minimum 
k=0 
Then, as seen in Appendix A (Section A-8), there is a unique solution. Such a unique 
solution gives the control sequence that brings an arbitrary initial state x(0) to the origin 
in N sampling periods and in so doing minimizes the total energy of control. 
The minimizing solution in such a problem, where the number of unknown 
variables is greater than the number of equations, can be obtained in terms of the right 
pseudoinverse (refer to Appendix A). The right pseudoinverse is defined as follows: 


FRM = F*(FF*)^! (8-146) 


By using the right pseudoinverse, the minimum-energy control sequence u(0), 
u(1),...,u(N — 1) that transfers an arbitrary initial state x(0) to the origin can be 
given by 


U = -F*"x(0) = —F*(FF*) ! x(0) (8-147) 
Note that F*(FF*) ! is an N x n matrix. Hence, F*(FF*) ! postmultiplied by x(0) is 
an N x 1 matrix. Equation (8-147) can be rewritten as follows: 
u(0) 
u(1) |. -re(gee)-1x(0) (8-148) 
u(N - 1) 
The control sequence given by Equation (8-148) will bring an arbitrary initial state to 


the origin in N sampling periods and will require the minimum control energy among 
all possible control sequences requiring N sampling periods. 
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Problem A-8-9 


Consider the system 


x(k + 1) = Gx(k) + Hu(k) (8-149) 


G- 1 0.6321 H- 0.3679 x(0| | 5 

0 0.3679 }’ 0.6321 |’ x2(0) -5 
It is desired to bring the initial state to the origin in three sampling periods. (The 
sampling period is assumed to be 1 sec.) Among infinitely many possible choices for 


the control sequence, determine the optimal control sequence that will minimize the 
control energy, or will minimize the following performance index: 


where 


Solution From Equation (8-144), the initial state x(0) can be written as follows: 
x(0) = —fiu(0) — f2u(1) — f3 u(2) 


where 
naga | 707181 nag _ | -3.6701 L ag — | 711.6939 
MEG u-| jar]. 3C H=| gem) PTC H=| 12.6939 
Hence, 
x(9]  [-o78]., _[-3.6701]  |-11.6939 
Boe | T luto | 46701 |“) 7 | 12.6039 |“) 
or 
x(0)|_ _[ -0.7181 -3.6701 -11.6939 ak (8-150) 
x,(0) 1.7181 4.670 12.6939 
u(2) 
By use of the right pseudoinverse, we can give the minimum norm solution to Equation 
(8-150) as 
u(0) 
u(1) |  -F'"x(0) = -rero [0 
u(2) x0) 
where 
F= —0.7181  —3.6701 —11.6939 
| 1.7181 4.6701 12.6939 
The right pseudoinverse F^" is determined as follows: 


—3.6701 4.6701 
—11.6939 12.6939 


0.7910 0.7191 
0.5000 0.4738 
—0.2910  —0.1929 


F^" = F*(FF*)" 


—0.7181 1.7181 
| —166.8147 185.8968 


150.7326 E 


Hence, 
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u(0) 07900 onal , —0.3598 
u()|--| 0.5000 0.4738 EH = | —0.1310 (8-151) 
u(2) —0.2910 —0.1929 0.4908 


The control sequence given by Equation (8-151) will bring the state to the origin in three 
sampling periods and will also minimize the total control energy. 

By using the optimal control sequence given by Equation (8-151), the state can 
be transferred as follows: 


x]. [1 o6] 5] , [0.3679], _[ 17071 
Ey = È ssa || | + Bi 0.3598] = Eng 
xQ)]. [1 0.6321][ 1.7071] , [0.3679], _| 0.3524 
zal - i 0.3679 || -2.0669 | * | 0.6321 |V- 01310] = | 0,8432 
x] [1 0.6321] 03524], [0.3679 _fo 
k9] = È osa d] * Loser [oos = H 

The minimum energy required for this control is 


Lac : Ya) = lu^) +A) a) = 30.3598)? + (0.1310)? + (0.4908)?] 


k= 
= 0.1937 


It is interesting to compare the minimum energy obtained here with the energy 
required for time-optimal control of this system. The time-optimal control requires two 
sampling periods. In Problem A-6-2, the time-optimal control sequence u (0) and u(1), 
where the sampling period was 1 sec, was found to be 


u(0) = —1.5820x,(0) — 1.2433x;(0) 
u(1) = 0.5820x,(0) + 0.2433x;(0) 


[Refer to Equation (6—231).] By taking x,(0) = 5 and x.(0) = —5 and substituting these 
values in these two equations, we obtain u(0) = —1.6935 and u(1) = 1.6935. Hence, 
for time-optimal control the total energy required is 


SO + w(1)) = 3[C- 1.6935 + (1.6935)] = 2.8679 


Notice that by allowing the control duration to be three sampling periods (3 sec), rather 
than two sampling periods (2 sec), the energy required can be reduced remarkably. 


Problem A-8-—10 


Consider the inverted pendulum system shown in Figure 8-10, where an inverted pendu- 
lum is mounted on a motor-driven cart. Here we consider only the two-dimensional 
problem in which the pendulum moves only in the plane of the paper. The inverted 
pendulum is unstable in that it may fall over anytime unless a suitable control force is 
applied. Assume that the pendulum mass is concentrated at the end of the rod as shown 
in the figure. (We assume that the rod is massless.) The control force u is applied to 
the cart. 

In the diagram, 6 is the angle of the rod from the vertical line. We assume that 
angle 6 is small so that we may approximate sin 0 by 0, cos 0 by 1, and also assume that 
6 is small so that 00? = 0. (Under these conditions, the system's nonlinear equations 
can be linearized.) 
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7 Figure 8-10 Inverted pendulum system. 


It is desired to keep the pendulum upright in response to step changes in the cart 
position. (The control force u is the force applied to the cart.) Derive first the contin- 
uous-time state-space model. Then discretize the continuous-time state-space model 
and obtain the discrete-time model. Assume that the sampling period T is 0.1 sec. 
Assume the following numerical values for M, m, and l: 


M=2kg, m=0.1kg, l=0.5m 
(In Section 8-4 we designed a digital controller for this inverted pendulum system.) 


Solution Define the angle of the rod from the vertical line as 6. (Since we want to keep 
the inverted pendulum vertical, angle 0 is assumed to be small.) Define also the (x, z) 
coordinates of the center of gravity of the mass as (xc, zc). Then 


xe =x t lsin8 
ZG —lcos0 


Applying Newton's second law to the x direction of motion yields 


d?x d'xg _ 
M tm dà u 
or 
d*x d? MET 
Mag + maak +/siné) =u (8-152) 


Noting that 


ar ; 
q 8 = (cos 8)0 


2 


L sin 8 = —(sin 6)8? + (cos 6)6 


d Dun 
di S 0 = —(sin 0)6 


2 


i cos 0 = —(cos 0)6? — (sin 6)6 
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Equation (8-152) can be written as 
(M + m)i — ml(sin 0)6? + ml(cos 6)6 = u (8-153) 


The equation of motion of the mass m in the z direction cannot be written without 
considering the motion of the mass m in the x direction. Therefore, instead of consid- 
ering the motion of the mass m in the z direction, we consider the rotational motion 
of the mass m around point P. Applying Newton’s second law to the rotational motion, 
we obtain 

2 2 


d xg diza : - . 
mgp | 00s @ m gg | Sin @ = mgl sine 


or 
d d 
| mc + Ísin oi cos à — nia cos a} sin 0 = mgl sin 0 


which can be simplified as follows: 
m[x — I(sin 6)6? + I(cos 6)6]/ cos @ — m[—I(cos 6)6? — I(sin 6)6]I sin 0 = mgl sin 0 
Further simplification results in 

mi cos0 + mló = mg sin (8-154) 


By substituting sin 0 = 0, cos 0 = 1, and 00? = 0, Equations (8-153) and (8-154) can 
be linearized as follows: 


(M + m) + ml6 =u (8-155) 
mx + mló = mg6 (8-156) 
These linearized equations are valid as long as @ and 6 are small. Equations (8-155) 
and (8-156) define a mathematical model of the inverted pendulum system. 
The linearized system equations, Equations (8-155) and (8-156), can be modi- 
fied to 
MI6 = (M + m)g@ - u (8-157) 
Mx = u — mg (8-158) 
Equation (8-157) was obtained by eliminating X from Equations (8-155) and 


(8-156). Equation (8-158) was obtained by eliminating 6 from Equations (8-155) and 
(8-156). Define state variables xı, x2, x3, and x4 by 


i= 
X2— 
X3—xXx 
X47 X 


Note that angle 0 indicates the rotation of the pendulum rod about point P, and x is 
the location of the cart. We consider x as the output of the system, or 


yYux =X3 


Then, from the definition of the state variables and Equations (8-157) and (8-158), we 
obtain 
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41 =X 
42 = M e = E 
MI MI 
X3 = X4 
; m 1 
X= — M^ + M" 
In terms of vector-matrix equations, we have 
0 10 0 0 
B T x AR. 5 E 
5| | o oon1[|zn|'| |" (tom 
Xa " z g 000 X4 a 
x 
y=[0 0 1 oP (8-160) 
Xa 


Equations (8-159) and (8-160) give a state-space representation of the inverted pendu- 
lum system. (Note that the state-space representation of the system is not unique. There 
are infinitely many such representations.) 
By substituting the given numerical values for M, m, and l, we obtain 
Mt+m m 1 1 
M 5" 20.601, ue 0.4905, Mi^ 1, M^ 0.5 

Then the state equation and output equation for the inverted pendulum with cart 
become as follows: 


X = Ax + Bu (8-161) 
y =Cx+ Du (8-162) 
where 
0 100 0 
_| 20.601 0 0 0 _|-1 " _ 
A= 0 0 0 1l B- 0r C-[0 0 1 Q0] D-0 
—0.4905 0 0 0 0.5 


Next, we discretize the state equation, Equation (8-161). The discretization can 
be accomplished by using the following MATLAB command: 


[G,H] = c2d(A,B,T) 


where T is the sampling period involved in the discrete-time control system. In this 
problem T — 0.1 sec. Then the command 


[G,H] = c2d(A,B,0.1) 


will transform the continuous-time state-space equation into the discrete-time state- 
space equation. See the following MATLAB command and output: 


Chap. 8 Problems 629 


1 
0 
0 
0 


B = [0;71;0;0.5]; 
(G,H] = c2d(A,B,0.1) 
G= 
1.1048 0.1035 
2.1316 1.1048 


—0.0025 —0.0001 1.0000 0.1000 
—0.0508 —0.0025 0 1.0000 


Thus, the discretized state-space model is given as follows: 
x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) + Du(k) 


where 

1.1048 0.1035 0 0 —0.0051 
G= 2.1316 1.1048 0 0 H= —0.1035 
—0.0025 -0.0000 1 O1J[' 0.0025 
—0.0508 -0.0025 0 1 0.0501 

c=[0 0 1 Oj, D= 

PROBLEMS 
Problem B—8-1 


Consider the discrete-time system 


x(k + 1) = Gx(k) + Hu(k) 


[53 n) m 


Determine the optimal control sequence u(k) that will minimize the following perfor- 
mance index: 


where 
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J= 2x* G)Sx(8) + 3 [x*(k)Qx(k) + u*(k)Ru(k)] 


where 


Problem B-8-2 
Consider the system 


x(k + 1) = Gx(k) + Hu(k) 


s [553 fi] 0- 


and the performance index 


where 


ye ix [x*(I) Qx(I) + u*(k)Ru(k)] 


where 


-|1 0 z 
o-|i T RIS 


Determine the optimal controllaw to minimize the performance index. Also, determine 
the minimum value of J. 


Problem B-8-3 
Consider the system defined by 


x(k + 1) = 1 1 x(k) xi(0) z 1 
x(k + 1) a —1]| x(k) f x2(0) 1 
where —1 <a < 0. Determine the value of a such that the performance index 
1< 
2^ x*(k)Qx(k) 


26 


J 


where 


is minimized. 
Problem B-8—4 
A discrete-time control system is described by the equation 
x(k + 1) = 0.3679x(k) + 0.6321u(k) 
Determine the optimal control law to minimize the following performance index: 


1= 23 10) +200) 


Also, determine the minimum value of the performance index J. 
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Problem B-8—5 


Consider the same system as discussed in Problem A-8-6. Is it possible to determine 
a positive definite matrix P for this system? Use Equation (8-101) for the determination 
of matrix P. 


Problem B-8-6 
Consider the system defined by the equations 
x(k + 1) = Gx(k) + Hu(k) 
y(k) = Cx(k) 


where x(k) is an n-vector, u(k) is an r-vector, y(k) is an m-vector, Gis ann X n matrix, 
H is an n X r matrix, and C is an m X n matrix. The performance index is 


J= ix [x*(k)Ox(k) + u*(k)Ru(k)] 


where Qis ann X n positive definite Hermitian matrix and Ris anr X r positive definite 
Hermitian matrix. Let us define the optimal control law that minimizes the performance 
index as u(k) = —Kx(k). 

Show that if the system is completely state controllable and observable then the 
algebraic Riccati equation 


P = Q + GPG* — GPC*(R + CPC*)"' CPG* 


has a unique positive definite solution. Show also that the optimal closed-loop system 
is stable, or G — HK is a stable matrix. 


Problem B-8—7 


Referring to Problem A—8-9, solve the same problem with MATLAB. Determine the 
optimal control sequence u(0), u(1), and u(2). 


Problem B-8-8 
Consider the system 
(k+l [1 1][ otk) 1 i [1i 
[e:p] eg] [iko iz |= [1] 


It is desired to bring the initial state to the origin in n sampling periods. Determine the 
optimal control law to minimize the control energy measured by 


Consider three values of n: n = 2, n = 3, and n = 4. 
Problem B-8-—9 


Consider the design of the servo system shown in Figure 8-11. The plant does not 
involve an integrator and, therefore, an integral controller is included in the loop. The 
sampling period T is 0.1 sec. 

Show that the system equations may be given by the following state-space equa- 
tions: 


x(k + 1) = Gx(k) + Hw(k) 
w(k) = —Kx(k) 
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rik - yik) 


Figure 8—11 A servo system. 


where 


x(k) = Bal - Es mnt) w(k) = u(k) - u(») 
0.5 0 2 
s-| 23 J u-| 1| K=[k -k] 
Problem B-8-10 


Referring to Problem B-8-9, it is desired to design the state feedback gain matrix 
K-[k; —kı] such that the system has reasonable step-response characteristics. Let 
us assume that we use the quadratic optimal control scheme. 

Let us assume the following performance index: 


J= > [x(k)*Ox(k) + w(k)*Rw(k)] 


If Q and R are chosen to be positive definite, the resulting system is stable. For this 
problem, we choose 
_|100 0 _ 
Q= | 0 ol, R=1 


Note that the present Q and R are only one possible set. (Other positive definite Q and 
R may be chosen. The resulting system is stable but different for each different set of 
Q and R.) 

Using the state-space representation shown in Problem B-8-9, determine matrix 
K with MATLAB. Write a MATLAB program. Using matrix K thus determined, 
obtain the unit-step response of the designed system with MATLAB. Plot y(k) versus 
k and v(k) versus k. 


Appendix A 


Vector-Matrix Analysis 


A-7 DEFINITIONS 


Matrices that we frequently encounter in the study of modern control theory are the 
symmetric matrix, skew-symmetric matrix, orthogonal matrix, Hermitian matrix, 
skew-Hermitian matrix, unitary matrix, and normal matrix. The following equations 
define these matrices: 


AT=A A is symmetric 

AT — -A A is skew-symmetric 
AA! — ATA=I A is orthogonal 

A*=A A is Hermitian 

A* = —A A is skew-Hermitian 
AA* = A*A - I A is unitary 


AA* = A*A or AAT = ATA A is normal 


where the superscript * denotes the conjugate transpose and superscript T signifies 
the transpose. 


A-2 DETERMINANTS 


Determinants of a 2 x 2 Matrix, a 3 X 3 Matrix, and a 4 x 4 Matrix. Fora 
2 x 2 matrix A, we have 


a, a 


IAl= |p p, 


= a,b, — ba, 
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For a 3 X 3 matrix A, 


a 0» a 
|A| = bi b, b, = d b;c, + bicza} + cab — cba — biac; — ai bae; 
Cı Cp G 


For a 4 x 4 matrix A, 
ai 05 04 d4 


b, b bb 
|A] = c c c c 
H 2 3 4 
d d; dj d, 
= QA, G45||C C4 _ {4 à b; b, 
bi b, d; d, Cy C2 d; d, 
" Qa, a, b; b, b, b, a3 a, 
d, d; C3 C4 Cy C d d, 
E b, b, Qa, ay Ci C2||ü035 a 
d, d; C3 C4 d, d; b, b, (A-1) 


(This expansion is called Laplace’s expansion by the minors.) 


Properties of the Determinant. The determinant of an n X n matrix has the 
following properties: 


1. Iftwo rows (or two columns) of the determinant are interchanged, only the sign 
of the determinant is changed. 


2. The determinant is invariant under the addition of a scalar multiple of a row 
(or a column) to another row (or column). 


3. If an n X n matrix has two identical rows (or columns), then the determinant 
is zero. 


4. For an n X n matrix A, 
lA] =|Al, — |A*| = [Al 


5. The determinant of a product of two n X n matrices A and B is the product 
of their determinants: 


|AB| = |A| |B| = |BA| 
6. If a row (or a column) is multiplied by a scalar k, then the determinant is 


multiplied by k. 


7. If all elements of an n X n matrix are multiplied by k, then the determinant 
is multiplied by k”; that is, 


IKA| = k"|Al 
8. If the eigenvalues of A are A; (i = 1,2,...,n), then 
JA] = À1À2 wee Àn 


Hence, |A| + 0 implies A; * 0 for i = 1,2,...,n. (For details of the eigen- 
value, see Section A-6.) 
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9. If matrices A, B, C, and Darean n x n,ann x m,anm x n,andanm x m 
matrix, respectively, then 
A B A 0 , 
a BILJA Pl, if A #0 and |D] #0 (A-2) 
A B A 0 ; 
onela o| =0, if [Al = 0 or [Dl = 0 or a] = [D| = 0 
Also, 
A d  [(IAlID- CA“ BI, if JA] 40 (A-3) 
C D ID||A — BD™ C], if [D| + 0 (A-4) 


10. 


[For the derivation of Equation (A-2), see Problem A-1. For derivations of 
Equations (A-3) and (A—4), refer to Problem A-2.] 


For an n X m matrix A and an m X n matrix B, 
IL, + AB| = |In + BA| (A-5) 


(For the proof, see Problem A-3.) In particular, form = 1, that is,forann X 1 


matrix A and a 1 X n matrix B, we have 
lI, + AB| 2 1 + BA (A-6) 


Equations (A-2) through (A-6) are useful in computing the determinants of 
matrices of large order. 


A-3 INVERSION OF MATRICES 


Nonsingular Matrix and Singular Matrix. A square matrix A is called a 


nonsingular matrix if a matrix B exists such that BA = AB = I. If such a matrix B 
exists, then it is denoted by A“. A! is called the inverse of A. The inverse matrix 
A^! exists if |A| is nonzero. If A^! does not exist, A is said to be singular. 


If A and B are nonsingular matrices, then the product AB is a nonsingular 


matrix and 
(AB)!-B'!A'! 
Also, 
(AT)? = (A7) 
and 
(A*)" = (A 
Properties of the Inverse Matrix. The inverse of a matrix has the following 
properties. 
1. If k is a nonzero scalar and A is an n X n nonsingular matrix, then 


pud -1 
(kA)! =7A 
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2. The determinant of A^! is the inverse of the determinant of A, or 


This can be verified easily as follows: 
IAA"| = lAl]A | = 1 
Useful Formulas for Finding the Inverse of a Matrix 


1. For a 2 x 2 matrix A, where 
a[i 4! ad — bc #0 
c d 


the inverse matrix is given by 


" 1 d -b 
A ad — bc| —c a 


2. For a3 X 3 matrix A, where 


abe 
A=|de f|, JA] + 0 
h i 


8 

the inverse matrix is given by 
e f| -| c | e| 
h i h i e f 
ETET 
lA | lg il dg il id f 


d e | -|a b| 2 b| 
g h g h d e 
3. If A, B, C, and D are, respectively, an n X n, an n X m, an m X n, and an 
m X m matrix, then 


(A + BDC)! = A^! — A"? B(D' + CAB) CA"! (A-7) 


provided the indicated inverses exist. Equation (A-7) is commonly referred to 
as the matrix inversion lemma. (For the proof, see Problem A-4.) 
If D = L,, then Equation (A-7) simplifies to 


(A + BC)! = A^! — A^ B(L, + CA^! B)! CA^! 


In this last equation, if B and C are an n X 1 matrix and a 1 X n matrix, 
respectively, then 


A` BCA”! 


“ls -1 20———————— EA 
(A + BC)! = A" -CATB (A-8) 


Sec. A-4 Rules of Matrix Operations 637 


Equation (A-8) is useful in that fan n X n matrix X can be written as A + BC, 
where A is an n X n matrix whose inverse is known and BC is a product of a 
column vector and a row vector, then X^! can be obtained easily in terms of 
the known A^, B, and C. 

4. If A, B, C, and D are, respectively, an n X n, an n X m, an m X n, and an 
m X m matrix, then 


[c lb = i + A"B(D- CA^B)'CA" -A^B(D- mM 


C D -(D - CA^! B) CA"! (D — CA^! B)! 
(A-9) 
provided |A| + 0 and |D — CA^! B| # 0, or 
[A An i | (A — BDC)?! -(A — BD^! C)" BD"! | 
C D -D'C(A - BD'C)" D^C(A - BDC)" BD"! + D~ 
(A-10) 


provided |D| # 0 and |A — BD™ C| + 0. In particular, if C = 0 or B = 0, then 
Equations (A-9) and (A-10) can be simplified as follows: 


-1 
A B A! -A'!BD' 
P 4 zi 0 p^ | (A-11) 
or 
-1 
A 0 A! 0 
le 4 = Ee CA^ o (A512) 
[For the derivation of Equations (A-9) through (A-12), refer to Problems A-5 
and A-6.] 


A-4 RULES OF MATRIX OPERATIONS 


In this section we shall review some of the rules of algebraic operations with matrices 
and then give definitions of the derivative and the integral of matrices. Then the rules 
of differentiation of matrices will be presented. 

Note that matrix algebra differs from ordinary number algebra in that matrix 
multiplication is not commutative and cancellation of matrices is not valid. 


Multiplication of a Matrix by a Scalar. The product of a matrix and a scalar 
is a matrix in which each element is multiplied by the scalar. That is, 


kay, kay S kai, 
kA =| Kaa Kam c kam 
kan kam MES kanm 


Multiplication of a Matrix by a Matrix. Multiplication of a matrix by a matrix 
is possible between matrices in which the number of columns in the first matrix is 
equal to the number of rows in the second. Otherwise, multiplication is not defined. 
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Consider the product of an n X m matrix A and an m X r matrix B: 


ij an occ dw bn bp occ bi, 
AB- an an e an ba by e by, 
am Am cC Arm \LBm 5m ocv b, 

Cu C2 ^'^ Cr 

2| n ^7 €» 

Cn Co ^O Cnr 


where 
m 
Cik = » aij by 
j=l 
Thus, multiplication of an n X m matrix by an m X r matrix yields an n X r matrix. 
It should be noted that, in general, matrix multiplication is not commutative; that is 
AB + BA in general 


For example, 
AB = [2s M bel = 5 bu + anba andy + ap ba! 
an an||bn bz Qy by + anbu anbn + andy 
and 
[bu bylfan an) _ | buau t+ bran bnan + by ax 
BA = = 
by bx | an az by ay + bnan bnan + bnan 


Thus, in general, AB + BA. Hence, the order of multiplication is significant and 
must be preserved. If AB = BA, matrices A and B are said to commute. In the 
preceding matrices A and B, if, for example, an = à» = by = bn = 0, then A and 
B commute. 

For n X n diagonal matrices A and B, 
aby, 0 
AB = [4;,8,,][5:;5:;] = anba t. 
0 AnnDnn 


If A, B, and C are ann X m matrix, anm Xr matrix, and an r X p matrix, 
respectively, then the following associativity law holds true: 


(AB)C = A(BC) 


This may be proved as follows: 


(i, k)th element of AB = 2 a;b; 
j=l 


(j, h)th element of BC = È Dye Cen 
k=l 
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(i, h)th element of (AB)C = > (5 aby Je = 25 (aij bi) Cer 
j=1 j=1k=1 


aj(bi cu) = È e bj, su] 
H k=1 


k= j=1 


= (i, h)th element of A(BC) 
Since the associativity of multiplication of matrices holds true, we have 
ABCD = (AB)(CD) = A(BCD) = (ABC)D 
A"*n = Am A” m,n —1,2,3,... 


- 
il 
= 


If A and B are n x m matrices and C and D are m x r matrices, then the 
following distributivity law holds true: 


(A + B)(C + D) = AC + AD + BC + BD 
This can be proved by comparing the (i, j)th element of (A + B)(C + D) and the 
(i, j)th element of (AC + AD + BC + BD). 


Remarks on Cancellation of Matrices. | Cancellation of matrices is not valid in 
matrix algebra. Consider the product of two singular matrices A and B. Take, for 


example, 
_{2 1 _ 1 -2 
asi JE B-|_ [+0 


Then 
-at tl [9-0]. 
as - |? JE- 2|- [à TET 


Clearly, AB = 0 implies neither A = 0 nor B = 0. In fact, AB = 0 implies one of the 
following three: 


1.A-90. 
2. B=0. 
3. Both A and B are singular. 


It can easily be proved that, if both A and B are nonzero matrices and AB = 0, 
then both A and B must be singular. Assume that B is nonzero and A is not singular. 
Then |A| # 0 and A™ exists. Then we obtain 


A'AB-B-0 


which contradicts the assumption that B is nonzero. In this way we can prove that 
both A and B must be singular if A # 0 and B + 0. 

Similarly, notice that if A is singular then neither AB = AC nor BA = CA 
implies B = C. If, however, A is a nonsingular matrix, then AB = AC implies B — € 
and BA = CA also implies B = C. 
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Derivative and Integral of a Matrix. The derivative of an n X m matrix A(t) 
is defined by the matrix whose (i, j)th element is the derivative of the (i, j)th element 
of the original matrix, provided that all the elements a;;(t) have derivatives with 
respect to t: 

d d 
u) i gar 
d A(t) = : : 
dt 
d d 
470 s gert) 


In the case of an n-dimensional vector x(t), 


S x(t) = 
dt d 
90 
dt^ 
Similarly, the integral of an n X m matrix A(t) with respect to t is defined by 


the matrix whose (i, j)th element is the integral of the (i, j)th element of the original 
matrix, or 


faat [ at) d 
A(t) dt = : : 

adt > Í ass (t) dt 
provided that the a;,(t)’s are integrable as functions of t. 


Differentiation of a Matrix. If the elements of matrices A and B are functions 
of t, then 


d d 


MCN (A-13) 
£ (AB) = = T + AZ (A-14) 


If k(t) is a scalar and is a function of t, then 


2 (Ak()] = Bee + AIEO (A-15) 
Also, 
[3 dà Bat = aB| -[ aa (A-16) 
It is important to note that the derivative of A"! is given by 
d aci cAÍA A (A-17) 


dt dr ^ 
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Equation (A-17) can be derived easily by differentiating AA 
Since 


d aci c dA ga y ATA 
ga = po ee dt 
and also 
d -1 E d = 
aoe =g? 
we obtain 
dA"! dA., 
m aA 
or 
dA! dA} dA 
-1 hide DE LOL ee S adt -1 
AU dt dt A g” 


which is the desired result. 


Derivatives of a Scalar Function with Respect to a Vector. 
function of a vector x, then 
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“| with respect to t. 


If J(x) is a scalar 


al à^J à^J a^ 
a óx, aay x, OX OX óx; óx, 
TEE: TF : : : 
oR aay is JI a o 
Xn OX, OX, OX» OX ox? 
Also, for a scalar function V(x(t)), we have 
d aV V dx 
gr (z) dt 


Jacobian. 
an n-vector is meant as an n-dimensional vector), then 
əfi ofr fm 
Ox, Ox, ox 1 
o£ | afi of fm 
ox OX, Ox; 0X; 
fi df fm 
OX, Ox, OX, 


Such an n X m matrix is called a Jacobian. 
Notice that, by using this definition of the Jacobian, we 


LA ET. 
axa A 


If an m X 1 matrix f(x) is a vector function of an n-vector x (note: 


(A-18) 


have 


(A-19) 
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The fact that Equation (A-19) holds true can be easily seen from the following 
example. If A and x are given by 


an ap a n 
A=|% 4v 45 ; x=|x 
Qn 5 05 


X3 
then 
Xx 
Ax =|% 42 43]. } = 4X, + dpX) + a3x3) _ | fi 
an ay ax an X, + dX? + 43X3 h 
and 
ofi df 
Ox, Ox, a a 
à n da 
— Ax = E 3f = | 4n an = AT 
ox OX, OX 
53 05 
ofi oh 
0X3 OX3 


Also, we have the following useful formula. For an n X n real matrix A and a real 
n-vector x, 


2 XT Ax = Ax + Ax (A-20) 
ox 
In addition, if matrix A is a real symmetric matrix, then 
ð AT 
—X' Ax = 2Ax 
ox 
Note that if A is an n X n Hermitian matrix and x is a complex n-vector then 
ð 
x*Ax =A A-21 
Fria AX x ( ) 


[For derivations of Equations (A-20) and (A-21), see Problem A-7.] 
For an n X m real matrix A, a real n-vector x, and a real m-vector y, we have 


IT Ay = - 
ox Ay = Ay (A-22) 
2 x" Ay = A'x (A-23) 
oy 


Similarly, for an n X m complex matrix A, a complex n-vector x, and a complex 
m-vector y, we have 


Ê aay = - 
aE Ay = Ay (A-24) 


2o = ATX — 
3y * Ay = A'X (A-25) 
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[For derivations of Equations (A-22) through (A—25), refer to Problem A-8.] Note 
that Equation (A25) is equivalent to the following equation: 


rv = A*x 


A-5 VECTORS AND VECTOR ANALYSIS 


Linear Dependence and Independence of Vectors. Vectors x,,X),... ,X, are 

said to be linearly independent if the equation 
CX, + OX + +++ +C,x, =0 

where c1, C2, . . . , C, are constants, implies that c; = c; = --- = c, = 0. Conversely, 
vectors X1, X2,... , x, are said to be linearly dependent if and only if x; can be expressed 
as a linear combination of x; (j = 1,2,...,n;j # i). 

It is important to note that if vectors xi, x), . . . , x, are linearly independent and 
vectors X1, X2, ... , Xn, X444 are linearly dependent, then x,,, can be expressed as a 
unique linear combination of xi, x;,. . . , Xn. 


Necessary and Sufficient Conditions for Linear Independence of Vectors. It 
can be proved that the necessary and sufficient conditions for n-vectors x; (i = 1, 
2,...,m) to be linearly independent are that 


1. mz n. 


2. There exists at least one nonzero m-column determinant of the n X m matrix 
whose columns consist of xi, X2, . . . , Xm. 


Hence, for n vectors xi, x, . . . , X, the necessary and sufficient condition for linear 
independence is 
lA| # 0 


where A is the n X n matrix whose ith column is made up of the components of x; 
(i = 1,2,...,n). 


Inner Product. Any rule that assigns to each pair of vectors x and y in a vector 
space a scalar quantity is called an inner product or scalar product and is given the 
symbol (x, y), provided that the following four axioms are satisfied: 

1. (y,x) = (x,y) 
where the bar denotes the conjugate of a complex number 
2. (cx, y) = €x, y) = (x, Cy) 
where c is a complex number 
3. (x +y,z + w) = (x,z) + (y,z) + (x, w) + (y, w) 
4. (x, x) > 0, forx # 0 
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In any finite-dimensional vector space, there are many different definitions of the 
inner product, all satisfying the four axioms. 

In this book, unless the contrary is stated, we shall adopt the following defini- 
tion of the inner product: The inner product of a pair of n-vectors x and y in a vector 
space V is given by 


(x,y) = Fiyi + aya too + Xy, = D Fiyi (A-26) 
i=1 
where the summation is a complex number and where the x;'s are the complex 


conjugates of the x;'s. This definition clearly satisfies the four axioms. The inner 
product can then be expressed as follows: 


(x, y) = x*y 
where x* denotes the conjugate transpose of x. Also, 
(x,y) = (yx) = y*x = y'x = xty (A-27) 


The inner product of two n-vectors x and y with real components is therefore 
given by 


(x,y) = iyi + Xayz + tt + Xy = DM (A-28) 
i=1 
In this case, clearly we have 


(x,y) =x"y=y"x, — for real vectors x and y 


It is noted that the real or complex vector x is said to be normalized if (x, x) = 1. 
It is also noted that, for an n-vector x, x*x is a nonnegative scalar, but xx* isan n X n 
matrix. That is, 


x*x = (X, X) = Xixi t XoXa cio + XnXn 
= pef + pa? ot baal? 
and 
Xi, XX2 o... XXn 
xx* = xi XX e XX, 
XXi XgX2 0... XXn 


Notice that, for an n X n complex matrix A and complex n-vectors x and y, 
the inner product of x and Ay and that of A*x and y are the same, or 


(x, Ay) = x*Ay, — (A*x, y) = x* Ay 


Similarly, for an n X n real matrix A and real n-vectors x and y, the inner product 
of x and Ay and that of A’x and y are the same, or 


(x, Ay) =x7Ay, (Ax, y) = x" Ay 


290 
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Unitary Transformation. If A is a unitary matrix (that is, if A! = A*), then 
the inner product (x, x) is invariant under the linear transformation x — Ay, because 


(x, x) = (Ay, Ay) = (y, A*Ay) = (y, A! Ay) = (y, y) 


Such a transformation x = Ay, where A is a unitary matrix, which transforms 
Ma Xx into Si yiyi, is called a unitary transformation. 


Orthogonal Transformation. If A is an orthogonal matrix (that is, if 
A^! = AT), then the inner product (x, x) is invariant under the linear transformation 
X — Ay, because 


(x, x) = (Ay, Ay) = (y, A’ Ay) = (y, A! Ay) = (y, y) 
Such a transformation x = Ay, which transforms $7-,x? into 9.1 y?, is called an 


orthogonal transformation. 


Norms of a Vector. Once we define the inner product, we can use this inner 
product to define norms of a vector x. The concept of a norm is somewhat similar 
to that of the absolute value. A norm is a function that assigns to every vector x in 
a given vector space a real number denoted by |x| such that 


1. ixi > 0, forx #0 
2. Ixl = 0, if and only if x = 0 
3. lkxll = |k] ixl, 


where k is a scalar and |k| is the absolute value of k 
4. Ix + yl s ixi + lly], for all x and y 
x, y) s [Ixilllyll (Schwarz inequality) 
Several different definitions of norms are commonly used in the literature. 


However, the following definition is widely used. A norm of a vector is defined as 
the nonnegative square root of (x, x): 


Ix = x, x)! = (x)? = Vl bof +--+ + ix (A-29) 


If x is a real vector, the quantity |x|? can be interpreted geometrically as the square 
of the distance from the origin to the point represented by the vector x. Note that 


lx — yl 2x - y, x - "^22 VG yi, + G2 ya tot On ys)? 


The five properties of norms listed earlier may be obvious, except perhaps the 
last two inequalities. These two inequalities may be proved as follows. From the 
definitions of the inner product and the norm, we have 


Ax + yl? = (Ax + y, Ax + y) = (Ax, Ax) + (y, Ax) + (Ax, y) + (y) 
= AAIxIP + Aly, x) + A(x, y) + Iyl? 
= All + (x, y) + A(x, y) + lly? = 0 
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If we choose 


, = — & 


x forx #0 
then 
— x, yx, 
AB a) + yi? = - SY + ay = 0 
and 


IIx|Pllyl? = (x, yXx,y) = x yf, forx #0 
For x = 0, clearly, 


Illy? = Kx, y)? 
Therefore, we obtain the Schwarz inequality, 
lx, y) = Ixl lly (A-30) 
By use of the Schwarz inequality, we obtain the following inequality: 
lix + yl] = [xl] Mil (A-31) 


This can be proved easily, since 
Ix + yl? = +y,x + y) 
= (x, x) + (x,y) + qx t.» 
= |x + (x,y) + Gy) + ly? 
= jix? + lly? + 2 Re (x, y) 
s xf! + llyl? + 2x, y) 
= xi? + liyi? + 2lixl iyi 
= (Ix + Iyl)? 


Equations (A-26) through (A-31) are useful in modern control theory. 
As stated earlier, different definitions of norms are used in the literature. 
Three such definitions of norms follow. 


1. A norm [Ix| may be defined as follows: 
ixi = [((Tx)*(Tx)]? = (x*T*T3)'? = (x*Qx)'? 


n n y2 
= [È Sauz: | z0 


i=1j=1 


The matrix Q = T*T is Hermitian, since Q* = T*T = Q. The norm |xl| = 
(x*Qx)"? is a generalized form of (x*x)"?, which can be written as (x*Ix)"?. 
2. Anorm may be defined as the sum of the magnitudes of all the components x;: 


n 
Ix] = È [xl 
i=1 
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3. A norm may be defined as the maximum of the magnitudes of all the compo- 
nents x;: 


Il = max (js) 
It can be shown that the various norms just defined are equivalent. Among 


these definitions of norms, norm (x*x)'? is most commonly used in explicit 
calculations. 


Norms of a Matrix. The concept of norms of a vector can be extended to 
matrices. There are several different definitions of norms of a matrix. Some of them 
follow. 


1. A norm {Al of an n X n matrix A may be defined by 
|All = mink 
such that 
||Ax|| = klx] 
For the norm (x*x)'^, this definition is equivalent to 
AI? = max {x*A*Ax; x*x = 1} 
which means that |A| is the maximum of the “absolute value" of the vector 


Ax when x*x = 1. 
2. A norm of an n X n matrix A may be defined by 


IAI = È 2 lai] 
i=1j=1 
where |a;| is the absolute value of a;;. 
3. A norm may be defined by 


n n 1/2 
jal = (È È es) 
i=1j= 
4. Another definition of a norm is given by 


lAl] = max (> i) 


Note that all definitions of norms of an n x n matrix A have the following 
properties: 
1 |All = IA*l| — or — AI = [AT] 
2 IA + Bl = |IAll + (IBI 
3. IABI| = [|All |B 
4 [Axl| = IIA] lix] 


Orthogonality of Vectors. If the inner product of two vectors x and y is zero, 
or (x,y) = 0, then vectors x and y are said to be orthogonal to each other. For 
example, vectors 
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1 0 1 
xi-7|1l|, X =10], x,7|-1 
0 1 0 


are orthogonal in pairs and thus form an orthogonal set. 
In an n-dimensional vector space, vectors X;, X2, . . . , X, defined by 


1 0 0 
B _|1 0 

X = ML X) = 2 > , X, = 
0 0 1 


satisfy the conditions (x;, xj) = 5,, or 
(x; , Xj) = 1 
(xi, xj) > 0, i *j 
where i,j = 1,2,...,n. Such a set of vectors is said to be orthonormal, since the 
vectors are orthogonal to each other and each vector is normalized. 
A nonzero vector x can be normalized by dividing x by ||x||. The normalized 
| vector x/|x| is a unit vector. Unit vectors X1, X2, . . . ,X„ form an orthonormal set if 
they are orthogonal in pairs. 


Consider a unitary matrix A. By partitioning A into column vectors Aj, 
A», ... , À,, we have 


AL 
A} ar ; 
A*A = |--|[A1: Agi +++: An] 
AF 
A] Ay At A> Ai A, 
= A} Ay Aj A» Aj A, 
Až A, Az A, Ar A, 
1 0 >- 0 
2160 d e 0 
D O aa 21 


it follows that 


A? A; = (A;, Ai) =1 


Thus, we see that the column vectors (or row vectors) of a unitary matrix A are 
orthonormal. The same is true for orthogonal matrices, since they are unitary. 
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A-6 EIGENVALUES, EIGENVECTORS, AND 
SIMILARITY TRANSFORMATION 


In this section we shall first review important properties of the rank of a matrix and 
then give definitions of eigenvalues and eigenvectors. Finally, we shall discuss Jordan 
canonical forms, similarity transformation, and the trace of an n X n matrix. 


Rank of a Matrix. A matrix A is called of rank m if the maximum number 
of linearly independent rows (or columns) is m. Hence, if there exists an m X m 
submatrix M of A such that |M| # 0 and the determinant of every r x r submatrix 
(where r = m + 1) of A is zero, then the rank of A is m. [Note that, if the 
determinant of every (m + 1) x (m + 1) submatrix of A is zero, then any determi- 
nant of order s (wheres > m + 1)iszero, since any determinant of order s > m + 1 
can be expressed as a linear sum of determinants of order m + 1.] 


Properties of Rank of a Matrix. We shall list important properties of the rank 
of a matrix in the following. 


1. The rank of a matrix is invariant under the interchange of two rows (or 
columns), or the addition of a scalar multiple of a row (or column) to another 
row (or column), or the multiplication of any row (or column) by a nonzero 
scalar. 


2. For an n X m matrix A, 
rank A = min (n,m) 


3. For an n X n matrix A, a necessary and sufficient condition for rank A — n is 
that |A| + 0. 


4. For an n X m matrix A, 
rank A* = rank A or rank A? = rank A 


5. The rank of a product of two matrices AB cannot exceed the rank of A or the 
rank of B; that is, 


rank AB = min (rank A, rank B) 


Hence, ifAisann x 1 matrix andBisal x m matrix, then rank AB = 1 unless 
AB = 0. If a matrix has rank 1, then this matrix can be expressed as a product 
of a column vector and a row vector. 


6. For an n X n matrix A (where |A| + 0) and an n x m matrix B, 
rank AB = rank B 
Similarly, for an m x m matrix A (where |A| * 0) and an n x m matrix B, 
rank BA = rank B 
Eigenvalues of a Square Matrix. For an n X n matrix A, the determinant 
|AI — Al 


is called the characteristic polynomial of A. It is an nth-degree polynomial in A. The 
characteristic equation is given by 


|AI — Aj = 0 
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If the determinant |AI — Al is expanded, the characteristic equation becomes 


À — ay —0) ut — in 
—a À—an c 7a 
JAI ES Al = 21 . 22 = 
7n m Ue À — Ann 


=A" +a A! b e ta 1A +a, =0 


The n roots of the characteristic equation are called the eigenvalues of A. They are 
also called the characteristic roots. 

It is noted that an n X n real matrix A does not necessarily possess real 
eigenvalues. However, for an n X n real matrix A, the characteristic equation 
|AI — A| = 0 is a polynomial with real coefficients, and therefore any complex 
eigenvalues must occur in conjugate pairs; that is, if a + j8 is an eigenvalue of A, 
then a — jf is also an eigenvalue of A. 

There is an important relationship between the eigenvalues of an n X n matrix 
A and those of A^!. If we assume the eigenvalues of A to be A; and those of A! to 
be y;, then 


moa, —i2135,2,..,n 


That is, if A; is an eigenvalue of A, then A; ! is an eigenvalue of A~’. To prove this, 
notice that the characteristic equation for matrix A can be written as 


|AI — Al = AA" — Ij AJ = JAA — A^! [A] = 0 
or 
ATI -A™“|=0 
By assumption, the characteristic equation for the inverse matrix A’ is 
lul - A^7| = 0 
By comparing the last two equations, we see that 
pB-A! 


Hence, if A is an eigenvalue of A, then u = A^! is an eigenvalue of A '!. 
Finally, note that it is possible to prove that, for two square matrices A and B, 


(AI — AB| = [AI — BA| 
(For the proof, see Problem A-9.) 
Eigenvectors of an n X n Matrix. Any nonzero vector x; such that 
Ax; = A,X; 


is said to be an eigenvector associated with an eigenvalue A; of A, where Aisann X n 
matrix. Since the components of x; are determined from n linear homogeneous 
algebraic equations within a constant factor, if x; is an eigenvector, then for any scalar 
a * 0, ax; is also an eigenvector. The eigenvector is said to be a normalized 
eigenvector if its length or absolute value is unity. 
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Similar Matrices. The n X n matrices A and B are said to be similar if a 
nonsingular matrix P exists such that 


PAP =B 


The matrix B is said to be obtained from A by a similarity transformation , in which 
P is the transformation matrix. Notice that A can be obtained from B by a similarity 
transformation with a transformation matrix P'!, since 


A = PBP” = (P~) B(P-)) 


Diagonalization of Matrices. If ann X n matrix A has n distinct eigenvalues, 
then there are n linearly independent eigenvectors. If matrix A has a multiple 
eigenvalue of multiplicity k, then there are at least one and not more than k linearly 
independent eigenvectors associated with this eigenvalue. 

If an n X n matrix has n linearly independent eigenvectors, it can be diagonal- 
ized by a similarity transformation. However, a matrix that does not have a complete 
set of n linearly independent eigenvectors cannot be diagonalized. Such a matrix can 
be transformed into a Jordan canonical form. 


Jordan Canonical Form. Ak X k matrix J is said to be in the Jordan canon- 
ical form if 


Jp, 0 
J= Jez . 
0 l Ip, 
where the J,,’s are p; X p; matrices of the form 

A 10.. 0 0 

0 A 1 --- 0 0 
J =j: : : Do: 

0 0 0 =. A 1 

000. OA 


The matrices J,, are called p; th-order Jordan blocks. Note that the A in J,, and that 
in J;, may or may not be the same, and that 


pDtpttpn.-k 


For example, in a 7 x 7 matrix J, if p; = 3, p; = 2, p = 1, p, = 1, and the eigenval- 
ues of J are À1, À1, À1, Ai, Ai, Ag, A7, then the Jordan canonical form may be given by 


B(A) 0 à 1 0! 0 | 
0 A 1! 
0 0 A! 
= J(A:) _ |---------- d-------4 
! 7 i Ar 1! 
(0 At 
HCAs) LA 
0 JA) 0 X] 


Notice that a diagonal matrix is a special case of the Jordan canonical form. 
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Jordan canonical forms have the properties that the elements on the main 
diagonal of the matrix are the eigenvalues of A and that the elements immediately 
above (or below) the main diagonal are either 1 or 0 and all other elements are zeros. 

The determination of the exact form of the Jordan block may not be simple. 
To illustrate some possible structures, consider a 3 X 3 matrix having a triple 
eigenvalue of A,. Then any one of the following Jordan canonical forms is possible: 


à 1 0 à 110 A10 0 
O M I1.) fO ajoj P OLATO 
0 0 A 0 OTA 0 0 X 


Each of the three preceding matrices has the same characteristic equation 
(A — A,)? = 0. The first one corresponds to the case where there exists only one 
linearly independent eigenvector, since by denoting the first matrix by A and solving 
the following equation for x, 


(A - A, Dx = 0 
we obtain only one eigenvector: 
a 
x= |0], a = nonzero constant 
0 


The second and third of these matrices have, respectively, two and three linearly 
independent eigenvectors. (Notice that only the diagonal matrix has three linearly 
independent eigenvectors.) 

As we have seen, if a k X k matrix A has a k-multiple eigenvalue, then the 
following can be shown: 


1. If the rank of AI — A is k — s (where 1 = s = k), then there exist s linearly 
independent eigenvectors associated with A. 

2. There are s Jordan blocks corresponding to the s eigenvectors. 

3. The sum of the orders p; of the Jordan blocks equals the multiplicity k. 


Therefore, as demonstrated in the preceding three 3 X 3 matrices, even if the 
multiplicity of the eigenvalue is the same, the number of Jordan blocks and their 
orders may be different depending on the structure of matrix A. 


Similarity Transformation When an n X n Matrix Has Distinct Eigenvalues. If 
n eigenvalues of A are distinct, there exists one eigenvector associated with each 
eigenvalue A;. It can be proved that such n eigenvectors x;, X2, . . . , X, are linearly 
independent. 

Let us define an n X n matrix P such that 


where column vector P; is equal to column vector x;, or 


P; = x;, i=1,2,...,n 


Sec. A-6 Eigenvalues, Eigenvectors, and Similarity Transformation 653 


Matrix P defined in this way is nonsingular, and P"! exists. Noting that eigenvectors 
X1, X2, ... , X, Satisfy the equations 


AX; = AVX 
AX; = À;X; 
Ax, = À,X, 
we may combine these n equations into one, as follows: 
A 0 
A[xi 132: 5 °°! Xn] = [x: x70 x] A2 
0 Àn 
or, in terms of matrix P, 
A 0 
Ap-P| ^. 
0 A. 
By premultiplying this last equation by P^!, we obtain 
A 0 
P-' AP = E = diag (Ay, Ao)... An) 
0 X 


Thus, matrix A is transformed into a diagonal matrix by a similarity transformation. 
The process that transforms matrix A into a diagonal matrix is called the 
diagonalization of matrix A. 
As noted earlier, a scalar multiple of eigenvector x; is also an eigenvector, since 
aX; satisfies the following equation: 


A(ax,;) = Ai(axj) 


Consequently, we may choose an a such that the transformation matrix P becomes 
as simple as possible. 

To summarize, if the eigenvalues of an n X n matrix A are distinct, then there 
are exactly n eigenvectors and they are linearly independent. A transformation 
matrix P that transforms A into a diagonal matrix can be constructed from such n 
linearly independent eigenvectors. 


Similarity Transformation When an n x n Matrix Has Multiple Eigenvalues. 
Let us assume that an n X n matrix A involves a k-multiple eigenvalue A, and other 
eigenvalues A,,, Àk+2; . .. , Àn that are all distinct and different from A,. That is, the 
eigenvalues of A are 


Ai, AL, ane , Ài; Akt, Àk+25 t sÀn 
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We shall first consider the case where the rank of A, I — A is n — 1. For such a case 
there exists only one Jordan block for the multiple eigenvalue A,, and there is only 
one eigenvector associated with this multiple eigenvalue. The order of the Jordan 
block is k, which is the same as the order of multiplicity of the eigenvalue A. 

Note that, when an n X n matrix A does not possess n linearly independent 
eigenvectors, it cannot be diagonalized, but can be reduced to a Jordan canonical 
form. 

In the present case, only one linearly independent eigenvector exists for A,. We 
shall now investigate whether it is possible to find k — 1 vectors that are somehow 
associated with this eigenvalue and that are linearly independent of the eigenvectors. 
Without proof, we shall show that this is possible. First, note that the eigenvector 
x, is a vector that satisfies the equation 


(A = À1 Dx, =0 


so that x; is annihilated by A — A,I. Since we do not have enough vectors that are 
annihilated by A — A,I, we seek vectors that are annihilated by (A — A, I), 
(A — AI), and so on, until we obtain k — 1 vectors. The k — 1 vectors determined 
in this way are called generalized eigenvectors. 


Let us define the desired k — 1 generalized eigenvectors as x2, X3, . . . , Xx. Then 
these k — 1 generalized eigenvectors can be determined from the equations 
(A -= Ài Dx, =0 


(A — ALD? x; =0 


(A — AD*x, = 0 (A-32) 


which can be rewritten as 
(A — Ài Dx, =0 
(A _ Ài Dx, = X; 


(A — Ai Dx, = X-i 
Notice that 
(A — A,D*'! x, = (A — Ay Ik? xy) =. = (A = AiDx =X, 
or 
(A - AD*'x, = Xi (A-33) 
The eigenvector x, and the k — 1 generalized eigenvectors x2, X3, . . . , x, determined 
in this way form a set of k linearly independent vectors. 
A proper way to determine the generalized eigenvectors is to start with x,. That 
is, we first determine the x, that will satisfy Equation (A—32) and at the same time 


will yield a nonzero vector (A — A:I)* ! x. Any such nonzero vector can be consid- 
ered as a possible eigenvector x,. Therefore, to find eigenvector x,, we apply a row 
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reduction process to (A — A I)* and find k linearly independent vectors satisfying 
Equation (A~32). Then these vectors are tested to find one that yields a nonzero 
vector on the right-hand side of Equation (A-33). (Note that if we start with x, then 
we must make arbitrary choices at each step along the way to determine x, 
X5... , X. This is time consuming and inconvenient. For this reason, this approach 
is not recommended.) 

To summarize what we have discussed so far, the eigenvector x, and the 
generalized eigenvectors x;, X3, . . . , x, satisfy the following equations: 


AX, = Ài Xi 


AX, X; + A, Xe 


AX, = Xa Ài Xx 


The eigenvectors X,41,Xx42,---,Xn associated with distinct eigenvalues A,.;, 
Àa2; - . . , Àn, respectively, can be determined from 


AX = Àk+1Xk+1 


ÁXy22 = Àk+2Xk+2 


AX, = À,X, 
Now define 
S = [S,:S.:--+:S,) = [xi x9: :x.] 
where the n column vectors of S are linearly independent. Thus, matrix S is nonsin- 


gular. Then, combining the preceding eigenvector equations and generalized eigen- 
vector equations into one, we obtain 


A[x::x?:-c:iXXiea ioco Xn] 

A, 1 0; 0 

ài 1 ! 

= [xiixoi xxix] 1 | 
. „Akti. n 0 Ld A 110 NENNEN 
0 | Ak 0 
0 | 0 An 

Hence, 
JO)! 0 0 
AS=S Ake 
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By premultiplying this last equation by S !, we obtain 


An 


In the preceding discussion we considered the case where the rank of à, I — A 
wasn — 1. Next we shall consider the case where the rank of A, I — Aisn — s (where 
2 =s =n). Since we assumed that matrix A involves the k-multiple eigenvalue A, 
and other eigenvalues A,.,, Ax+2,..., A, that are all distinct and different from A,, we 
have s linearly independent eigenvectors associated with eigenvalue A,. Hence, there 
are s Jordan blocks corresponding to eigenvalue Aj. 

For notational convenience, let us define the s linearly independent eigenvec- 


tors associated with eigenvalue A, as vi, V21,.. 
eigenvectors associated with vj; as Viz, Vis, . . 


. , V4. We shall define the generalized 
Vig, Where i = 1,2,...,s. Then there 


are altogether k such vectors (eigenvectors and generalized eigenvectors), which are 


Vir V125 < + < s Vipp Va V22)- - 


The generalized eigenvectors are determined from 


(A — Ay Dv; 
(A — Ài Dvi; = 


0, 


Viis 


. 2 V2p.> es Vans » Vsp, 
(A — Ài Dv, =0 
= Va 


(A = Ai Dv; 


(A = Ay Dv;,, = Vipi- 


where the s eigenvectors vi, V2, . 


(A — ADV, = Vg, 
.. , V, are linearly independent and 
Pit pots +p =k 


Note that p;,p2,...,ps; represent the order of each of the s Jordan blocks. (For 
the determination of the generalized eigenvectors, we follow the method dis- 
cussed earlier. For an example showing the details of such a determination, see 
Problem A-11.) 


Let us define an n x k matrix consisting of V11, V12, - - . , Vsp, aS 
S(A)) = [vu : vi: ttt Yip it eivai Vga: tt ivy] 
= [xi X217 Xp, itte EX] 
= [S;:S:---:S,] 
and define 
S= [S(à;) : Sua : S: ttti S,] 
= [S,:S.:---:S8,] 
where 
Sia = Xiep Sia; = Xks2s ty S, = X, 
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Note that X,,1,X,,5,...,X, are eigenvectors associated with eigenvalues Ag+, 
Ag+2, +++, An, respectively. Matrix S defined in this way is nonsingular. Now we obtain 


Jp (à) 0 ! 0 
Jp (à) | 
AS-S| 0 J,0): 0 
mM OTA 0 
0 10 dn 
where J, (A) is in the form 
à 1 0 
A, 1 
Jp(A1) = 
1 
0 A 
which is a p; X p; matrix. Hence, 
Jp (à) 0 | 0 
J,,(4)) ! 
I 
S"AS- | 0 OO 0 
ee Ü Xu 0 
l 
0 i O An 


Thus, as we have shown, by using a set of n linearly independent vectors 
(eigenvectors and generalized eigenvectors), any n X n matrix can be reduced to a 
Jordan canonical form by a similarity transformation. 


Similarity Transformation When an n x n Matrix Is Normal. First, recall 
that a matrix is normal if it is a real symmetric, a Hermitian, a real skew-symmetric, 
a skew-Hermitian, an orthogonal, or a unitary matrix. 

Assume that an n X n normal matrix has a k-multiple eigenvalue A, and that 
its other n — k eigenvalues are distinct and different from A. Then the rank of 
A — AI becomes n — k. (Refer to Problem A-12 for the proof.) If the rank of 
A — Ailis n — k, there are k linearly independent eigenvectors xi, x; . . . , x, that 
satisfy the equation 


(A — A; Dx; = 0, i=1,2,...,k 


Therefore, there exist k Jordan blocks for eigenvalue A,. Since the number of Jordan 
blocks is the same as the multiplicity number of eigenvalue A,, all k Jordan blocks 
become first order. Since the remainingn — k eigenvalues are distinct, the eigenvec- 
tors associated with these eigenvalues are linearly independent. Hence, the n x n 
normal matrix possesses altogether n linearly independent eigenvectors, and the 
Jordan canonical form of the normal matrix becomes a diagonal matrix. 
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It can be proved that if Aisan n X n normal matrix, then, regardless of whether 
or not the eigenvalues include multiple eigenvalues, there exists an n X n unitary 
matrix U such that 


U`! AU = U*AU = D = diag (Ai, Ad, e, An) 
where D is a diagonal matrix with n eigenvalues as diagonal elements. 
Trace of an n X n Matrix. The trace of an n X n matrix A is defined as 
follows: 
trace of A= trA = > ai 
i=1 


The trace of an n X n matrix A has the following properties: 


1. trA’=trA 
2. For n X n matrices A and B, 
tr(A + B) = trA + trB 
3. If the eigenvalues of A are denoted by A}, 45, . .. , Àn, then 
trA SAL TAÀ tAn (A-34) 
4. Forann X mmatrix Aandanm X n matrix B, regardless of whether AB = BA 
or AB + BA, we have 
tr AB = trBA = È S aby 
i=1j= 
If m = 1, then by writing A and B as a and b, respectively, we have 
trab = ba 
Hence, for an n X m matrix C, we have 
a'Ca = traa’C 
Note that Equation (A-34) may be proved as follows. By use of a similarity 
transformation, we have 


P^! AP = D = diagonal matrix 
or 
S^! AS = J = Jordan canonical form 
That is, 
A = PDP" or A-SJS! 
Hence, by using property 4 listed here, we have 
trA = trPDP! =trP PD = trD = à + àt ee +A, 
Similarly, 
trA 2 trSJS! =trS'SJ=trJ = àt ot tA, 
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Invariant Properties Under Similarity Transformation. If an n X n matrix A 
can be reduced to a similar matrix that has a simple form, then important properties 
of A can be readily observed. A property of a matrix is said to be invariant if it is 
possessed by all similar matrices. For example, the determinant and the character- 
istic polynomial are invariant under a similarity transformation, as shown in the 
following. Suppose that P^! AP = B. Then 


|B| = |P" AP| = |P "| |A] |P| = |A| [P~] [P| = |A] |P- P| 
= |A] iI] = [A] 
and 
|AI - B| = |AI — P~ AP| = [P (ADP — P^! AP| 
= [P(A - A)P| = [P7']laT — Al |P] 
= | - Al|P™ [P| = JAI — Al 


Notice that the trace of a matrix is also invariant under similarity transformation, 
as was shown earlier: 


trA = tr P~! AP 


The property of symmetry of a matrix, however, is not invariant. 

Notice that only invariant properties of matrices present intrinsic characteris- 
tics of the class of similar matrices. To determine the invariant properties of a matrix 
A, we examine the Jordan canonical form of A, since the similarity of two matrices 
can be defined in terms of the Jordan canonical form: The necessary and sufficient 
condition for n X n matrices A and B to be similar is that the Jordan canonical form 
of A and that of B be identical. 


A-7 QUADRATIC FORMS 


Quadratic Forms.  Foranz x nreal symmetric matrix A and a real n-vector 
x, the form 
n n 
x'Ax- 3 È agxix;, lji = dij 
i=1j=1 
is called a real quadratic form in x;. Frequently, a real quadratic form is called simply 
a quadratic form. Note that x" Ax is a real scalar quantity. 
Any real quadratic form can always be written as x’ Ax. For example, 


1 -1 2 Xi 
x = 2x1 X2 + 4x, Xs + xi + 8x? = [x X x3] —1 1 0 X5 
2 0 8 X3 


It is worthwhile to mention that, for an n X n real matrix A, if we define 
B=}(A+A’) and C=3(A- A’) 
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then 
A=B+C 
Notice that 
B'-B and C'--C 


Hence, an n X n real matrix A can be expressed as a sum of a real symmetric and 
a real skew-symmetric matrix. Since x’ Cx is a real scalar quantity, we have 


x! €x = (x7 Cx)! = x! C7x = ~x" Cx 
Consequently, we have 
x'Cx = 0 
This means that a quadratic form for a real skew-symmetric matrix is zero. Hence, 
x’ Ax = x'(B + C)x = x’ Bx 


and we see that the real quadratic form x’ Ax involves only the symmetric component 
x’ Bx. This is the reason why the real quadratic form is defined only for a real 
symmetric matrix. 

For a Hermitian matrix A and a complex n-vector x, the form 


non 
x*Ax = 2m > dijXiXj, 4j = dij 
i=1j=1 
is called a complex quadratic form, or Hermitian form. Notice that the scalar 
quantity x*Ax is real, because 


x*Ax = x? Ax = (x? Ax)’ = X A'x = x*Ax 


Bilinear Forms. For an n X m real matrix A, a real n-vector x, and a real 
m-vector y, the form 


x! Ay = > > aijxiy; 
i=1j=} 
is called a real bilinear form in x; and y;. x’ Ay is a real scalar quantity. 


For ann x m complex matrix A, a complex n-vector x, and a complex m-vector 
y, the form 


x*Ay — > Y ajX;y; 
i=1j=1 
is called a complex bilinear form. x*Ay is a complex scalar quantity. 


Definiteness and Semidefiniteness. A quadratic form x’ Ax, where A is a real 
symmetric matrix (or a Hermitian form x*Ax, where A is a Hermitian matrix), is said 
to be positive definite if 


x Ax 20 (orx*Ax>0), forx #0 
x'Ax-0  (orx*Ax-0) forx=0 
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x’ Ax (or x*Ax) is said to be positive semidefinite if 
x'AxzO0 (orx*Ax20), forx #0 
x'Ax-0 (orx*Ax=0), forx=0 

x’ Ax (or x*Ax) is said to be negative definite if 
x'Ax «0  (orx*Ax «0) forx #0 
x'Ax-0  (orx*Ax-0)  forx-0 

x’ Ax (or x*Ax) is said to be negative semidefinite if 
x 'Axx0  (orxfAxs0) forx #0 
x'Ax-0 (orx*Ax=0),  forx-0 


If x” Ax (or x*Ax) can be of either sign, then x" Ax (or x*Ax) is said to be indefinite. 

Note that if x" Ax or x*Ax is positive (or negative) definite we say that A is a 
positive (or negative) definite matrix. Similarly, matrix A is called a positive (or 
negative) semidefinite matrix if x7 Ax or x*Ax is positive (or negative) semidefinite; 
matrix A is called an indefinite matrix if x" Ax or x*Ax is indefinite. 

Note also that the eigenvalues of an X n real symmetric or Hermitian matrix 
are real. (For the proof, see Problem A-13.) It can be shown that an n X n real 
symmetric or Hermitian matrix A is a positive definite matrix if all eigenvalues A; 
(i = 1,2,...,n)are positive. Matrix A is positive semidefinite if all eigenvalues are 
nonnegative, or A; = 0 (i = 1,2,...,7), and at least one of them is zero. 

Notice that if A is a positive definite matrix then |A| # 0, because all eigen- 
values are positive. Hence, the inverse matrix always exists for a positive definite 
matrix. 

In the process of determining the stability of an equilibrium state, we fre- 
quently encounter a scalar function V(x). A scalar function V(x), which is a function 


of X1,X2,...,X,, iS said to be positive definite if 
V(x) > 0, forx #0 
v(0) = 0 


V(x) is said to be positive semidefinite if 
V(x) = 0, forx #0 
V(0) = 0 
If —V(x) is positive definite (or positive semidefinite), then V(x) is said to be 
negative definite (or negative semidefinite). 
Necessary and sufficient conditions for the quadratic form x" Ax (or the Her- 


mitian form x*Ax) to be positive definite, negative definite, positive semidefinite, 
or negative semidefinite have been given by J. J. Sylvester. Sylvester's criteria follow. 


Sylvester's Criterion for Positive Definiteness of a Quadratic Form or Hermitian 
Form. A necessary and sufficient condition for a quadratic form x" Ax (or a 
Hermitian form x*Ax), where A is an n X n real symmetric matrix (or Hermitian 
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matrix), to be positive definite is that the determinant of A be positive and the 
successive principal minors of the determinant of A (the determinants of the k x k 
matrices in the top-left corner of matrix A, where k = 1,2,...,n — 1) be positive; 
that is, we must have 


ds ap äu d dg 
a, > 0, Pr Ei 0, an an ay! > 0, = |A| > 0 
= 05 d» 5 
where 


dij = dj, for real symmetric matrix A 
dj; = dj, for Hermitian matrix A 


Sylvester’s Criterion for Negative Definiteness of a Quadratic Form or Hermitian 
Form. A necessary and sufficient condition for a quadratic form x’ Ax (or a 
Hermitian form x*Ax), where A is an n X n real symmetric matrix (or Hermitian 
matrix), to be negative definite is that the determinant of A be positive if n is even 
and negative if n is odd, and that the successive principal minors of even order be 
positive and the successive principal minors of odd order be negative; that is, we must 
have 


Qy dp a 

0, Qj an ay! <0, 
035 05 433 

ja] > 0 (n even) 


lÀ| «0 (nodd) 


4 p 


a, < 0, acd 
1 ay 


where 
dij = dj, for real symmetric matrix A 
a; —üj, for Hermitian matrix A 
[This condition can be derived by requiring that x'(—A)x be positive definite. ] 
Sylvester’s Criterion for Positive Semidefiniteness of a Quadratic Form or Her- 
mitian Form. A necessary and sufficient condition for a quadratic form x" Ax (or 
a Hermitian form x*Ax), where A is a real symmetric matrix (or a Hermitian matrix), 
to be positive semidefinite is that A be singular (|A| = 0) and all the principal minors 
be nonnegative: 
. dj di di 
= 0, aji Ajj Gik = 0, iy |A| =0 
Aki Ag A 


aj; 2 0, 


where i < j < k and 
dij = dj, for real symmetric matrix A 


dij = dj, for Hermitian matrix A 
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(It is important to point out that in the positive semidefiniteness test or negative 
semidefiniteness test we must check the signs of all the principal minors, not just 
successive principal minors. See Problem A-15.) 


Sylvester's Criterion for Negative Semidefiniteness of a Quadratic Form or a 
Hermitian Form. A necessary and sufficient condition for a quadratic form x’ Ax 
(or a Hermitian form x*Ax), where A is an n X n real symmetric matrix (or Her- 
mitian matrix), to be negative semidefinite is that A be singular (|A| = 0) and that 
all the principal minors of even order be nonnegative and those of odd order be 
nonpositive: 


di; dij 
aj Ajj 


aj = 0, = 0, Aji dj Ajk - 0, atta Jey |A| =0 


Aki Any Akk 
where i < j < k and 


ij = dji, for real symmetric matrix A 


aij = dj, for Hermitian matrix A 


A-8 PSEUDOINVERSES 


The concept of pseudoinverses of a matrix is a generalization of the notion of an 
inverse. It is useful for finding a “solution” to a set of algebraic equations in which 
the number of unknown variables and the number of independent linear equations 
are not equal. 

In what follows, we shall consider pseudoinverses that enable us to determine 
minimum norm solutions. 


Minimum Norm Solution That Minimizes |x|. Consider a linear algebraic 
equation 


xi *t5x,-1 


Since we have two variables and only one equation, no unique solution exists. 

Instead, there exist an infinite number of solutions. Graphically, any point on line 

xi + 5x, = 1, as shown in Figure A-1, is a possible solution. However, if we decide 

to pick the point that is closest to the origin, the solution becomes unique. 
Consider the vector-matrix equation 


Ax =b (A-35) 


where A is an n X m matrix, x is an m-vector, and b is an n-vector. We assume that 
m > n (that is, the number of unknown variables is greater than the number of 
equations) and that the equation has an infinite number of solutions. Let us find 
the unique solution x that is located closest to the origin or that has the minimum 
norm |[Ix||. 

Let us define the minimum norm solution as x°. That is, x? satisfies the 
condition that Ax? = b and ||x°|| = |[xi| for all x that satisfy Ax = b. This means that 
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X2 


xX, +5x.=1 


Figure A-1 Line x, + 5x; = 1 on the 
X,%2 plane. 


0 02 04 06 08 10 X, 


the solution point x° is nearest to the origin of the m-dimensional space among all 
possible solutions of Equation (A-35). We shall obtain such a minimum norm 
solution in the following. 


Right Pseudoinverse Matrix. For a vector-matrix equation 
Ax = b 


where A is an n x m matrix having rank n, x is an m-vector, and b is an n-vector, 
the solution that minimizes the norm |įx|] is given by 


x = AM 


where A™ = AT(AAT) !. 
This can be proved as follows. First, note that norm ||x| can be written as 
follows: 


lxil = lx — x^ + x*l = [[x°l] lix — x°l] 260)'(x — x?) 
The last term, 2(x?)'(x — x^), can be shown to be zero, since 
(x°)"(x — x°) = [A'(AA7) ! b'[x — A'(AAT)"! b] 
= b/'(AA")"! A[x — A'(AAT)"! b] 
= b'(AA") [Ax — (AAD(AAT)"! bJ 
= b'(AAT)*Y(b — b) 
=0 
Hence, 
liil = I^ + [lx — xl 
which can be rewritten as 
ixi — °l = iix — xl 
Since |x — x?^| = 0, we obtain 
ixi] = lix" 


Thus, we have shown that x? is the solution that gives the minimum norm ||x|.. 
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The matrix A"^ = A"'(AA")"! that yields the minimum norm solution 
(\ix°|| = minimum) is called the right pseudoinverse or minimal right inverse of A. 


Summary On the Right Pseudoinverse Matrix. The right pseudoinverse AFM 
gives the solution x? = A" b that minimizes the norm, or gives ||x°|| = minimum. 
Note that the right pseudoinverse A*" is an m X n matrix, since Aisann X m matrix 
and 


ARM = A'(AATy'! 


(m X n matrix)(n X n matrix)! 


=m X n matrix, mn 


Notice that the dimension of AA" is smaller than the dimension of vector x, which 
is m. Notice also that the right pseudoinverse A®™ possesses the property that it is 
indeed an "inverse" matrix if premultiplied by A: 


AA = A[AT(AAT)"!] = AA'(AAT)"! = I, 


Solution That Minimizes ||Ax — b||. Consider a vector-matrix equation 
Ax = b (A-36) 


where A is ann X m matrix, x is an m-vector, and b is an n-vector. Here we assume 
that n m. That is, the number of unknown variables is smaller than the number 
of equations. In the classical sense, there may or may not exist any solution. 

If no solution exists, we may wish to find a unique “solution” that minimizes 
the norm ||Ax — b||. Let us define a solution" to Equation (A—36) that will minimize 
Ax — b|| as x°. In other words, x? satisfies the condition 


lAx — bj = ||Ax° — bl, for all x 


Note that x? is not a solution in the classical sense, since it does not satisfy the 
original vector-matrix equation Ax = b. Therefore, we may call x° an “approximate 
solution," in that it minimizes norm [Ax — bj]. We shall obtain such an approximate 
solution in the following. 


Left Pseudoinverse Matrix. For a vector-matrix equation 
Ax =b 


where A is an n X m matrix having rank m, x is an m-vector, and b is an n-vector, 
the vector x? that minimizes the norm ||Ax — bl| is given by 


x? = AMb = (ATA)! ATb 


where A™ = (ATA) ! AT. 
To verify this, first note that 


lAx — b|| = |A(x — x°) + Ax" — bl 
= ||A(x — x?) + Ax" — bli + 2[A(x — x°)}"(Ax? — b) 


The last term can be shown to be zero as follows: 
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[A(x — x)]'(Ax? — b) = (x - x! A[TA(AT A) ! A7 — L]b 
= (x - x [((ATAYATA) ! A7 — AT]b 
y = (x — x°) "(AT — A’)b 

-0 

Hence, 
lAx — bl = |A(x — x) + |Ax? — bl 
Noting that ||A(x — x°)|| = 0, we obtain 
Ax — bl| - Ax? — bij = A(x - x°)|| = 0 
or 
Ax — b|| = Ax" — bl 
Thus, 
x? = A™ b = (ATA) ! ATb 


minimizes ||Ax — bj. 


App. A 


The matrix A™ = (ATA) ! A" is called the left pseudoinverse or minimal left 
inverse of matrix A. Note that A’™ is indeed the inverse matrix of A, in that if 


postmultiplied by A it will give an identity matrix L,: 
A™ A = (ATA) '! AT A = (ATA) (AT A) = I, 


EXAMPLE PROBLEMS AND SOLUTIONS 


Problem A-1 


Show that if matrices A, B, C, and Dareann X n,ann x m,anm X n,andanm X m 


matrix, respectively, and if |A| + 0 and |D] + 0, then 
A B| IA 0|. 
A Bl -|A S-jibisO, — if|A| +0 and p] +0 


Solution Since matrix A is nonsingular, we have 
A B| lA o|[1 ol|1 A"B 
0 D| {0 Ijjo DJ|O I 


f B| _ | oJI al ^ P|- 
oD! io 110 DIO I 


Hence, 
|A| |D| 


Similarly, since D is nonsingular, we get 


A 9| |A ojja dl I E 
lc D F illo pip'c 1| 7 AP 
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Problem A-2 


Show that if matrices A, B, C, and Dareann X n, ann X m,anm X n,andanm x m 
matrix, respectively, then 


a B| j|A[D — CA'!B, _ ifjA| #0 
c D! |IiD|A- BD'C| _ if |D) #0 
Solution if |A| + 0, the matrix 

A B 

C D 
can be written as a product of two matrices: 


A 0] aq [hb A75 

C I, 0 D-CA"B 

A B| [A oļi  a-B 

c D| |C L,||0 D-CA^"B 
I, AB 


Slt ell ote 
C DI Ic L,/ 0 D-CA^B 
= |A|IL,|[L.]|D — CA^! B| 
= |A||D — CA"! B| 


or 


Hence, 


Similarly, if [D| # 0, then 
A B|_[1, B|/A-BD'C o 
C D 0 D D'c In 
le B| |l, M A-BD'C 0 
C D 0 D D'c LỌ 


= |L,||[D||A — BD"' C| |En] 
= |D||A - BD^'C 


and therefore 


Problem A-3 
For an n X m matrix A and an m X n matrix B, show that 
IL, + AB| = |In + BA| 


Solution Consider the following matrix: 
l -A 
B L, 


ia B| _ J |A||D - CA"B|, _ if |A| #0 
C D ID|A - BD'Cj, if |D| #0 


Referring to Problem A-2, 
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Hence, 
I; 35 " Enin + BA| = In + BAJ 
B L, IL.||L. + AB| = [L. + AB| 
and we have 
I, + AB| = |in + BA| 
Problem A-4 


If A, B, C, and D are, respectively, an n X n, an n X m, an m X n, and an m x m 
matrix, then we have the following matrix inversion lemma: 


(A + BDC)' = A! - A" B(D'« CA^?! B)! CA" 
where we assume the indicated inverses to exist. Prove this matrix inversion lemma. 
Solution Let us premultiply both sides of the equation by (A + BDC): 
(A + BDC)(A + BDC)'! = (A + BDCJA ! - A"! B(D' + CA?!B)'CA"] 
or 
I = I + BDCA™ - B(D' + CA! B) 'CA'! - BDCA~'B(D™! + CA^!B)'! CA"! 
= I + BDCA™ - (B + BDCAB)(D' + CA"! B)'!CA" 
= I + BDCA'! - BD(D' + CA^ B)(D' + CA^! B)''CA^ 
= I + BDCA™' - BDCA™ 
=I 


Hence, we have proved the matrix inversion lemma. 


Problem A-5 


Prove that if A, B, C, and D are, respectively, an n X n, an n X m, anm X n, and an 
m X m matrix, then 
—1 
A B| [|A" -A"BD" 
E 4 z | 0 p^ | (A-37) 
provided |A| # 0 and |D| # 0. 


Prove also that 
-1 
A 0 A! 0 
E $ ee A (A-38) 


provided |A| # 0 and |D] + 0. 
Solution Note that 


A" -A"BD'||A B MP" A'B-— A7'B {In 0 
0 D' 0 D 0 In 0 In 
Hence, Equation (A-37) is proved. Similarly, 


A^ o lA o]. I, 0| [r o 
-D'cA" DOC D] |-p'c+pD'c r|^:0 In 


Hence, we have proved Equation (A-38). 
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Problem A-6 
Prove that if A, B, C, and D are, respectively, an n X n, ann X m,an m X n, andan 
m X m matrix, then 


A B|? [A^"-A^"B(D- CA?7B)'CA" -A^B(D- CA^B)" 

C D -(D- CA'!B)'CA" (D- CA^! B)! 
provided |A| + 0 and [D — CA ! B| + 0. 

Prove also that 


A B]|'. (A - BDC)! -(A - BD C)! BD 
C D -p'C(A - BDC) D'C(A- BDC) BD + D^ 


provided |D| + 0 and |A — BD^' C| + 0. 
Solution First, note that 


-1 
E J = E WE D Aral (A-39) 
By taking the inverse of both sides of Equation (A—39), we obtain 
E 4 - ls A^B llt 0 | 
€ D 0 D-CA'B C In 
By referring to Problem A-5, we find 


L  A^B [|' [rn -A^B(p-CA^B)^ 
0 D-CA'"B 0 — (D-CA^B)" 


A o]'_[ at o 
C L, -CA" I, 
Hence, 


A B| [t "B | [a of 
C D 0 D-CA^B| |C In 
[rn -A"7BD-CA^"B)'| A^ o 
0  (D-CA^7B)' j|[-CA" L, 
_ [A7 + A? B(D - CA^B)'CA"  -A^B(D - CAB)? 
-(D - CA^ B) CA^ (D - CA^! B)! 


provided |A| + 0 and [D — CA! B| + 0. 
Similarly, notice that 


A B| |L B|A-BD'C 0 
E 4 = E 4l D^c e] (A-40) 
By taking the inverse of both sides of Equation (A—40) and referring to Problem A-5, 
we obtain 


A B|' [A-sp^?c o| [un B|" 

C D D'C Lj|9D 

_ (A - BD! C)! o | -Bp^ 
 |-D'C(A-BD'C)' Ini 0 D“ 


[| (A-BD"C)? -(A — BD^ C)! BD" 
-D'C(A-BD'C)' D'C(A- BD^ C)" BD + D^ 


provided |D| + 0 and |A — BD™'C} + 0. 
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Problem A-7 
For an n X n real matrix A and real n-vectors x and y, show that 
LN 
(a) mI TY 
(b) 2 Tix = Ax + A’x 
Ox 


For an n X n Hermitian matrix A and a complex n-vector x, show that 


(c) Z y*Ax = Ax 
Solution 
(a) Note that 
YTX = yidi + yaxo b ib Yan 
which is a scalar quantity. Hence, 


à 
ð ae) * ^ 
—yixy= : — : m 
ox? x ' y 
ð Ta 
x, y Yn 


(b) Notice that 


n n 
T = 
X Ax = X 5 Qij XiX; 
i=1j=1 
which is a scalar quantity. Hence, 


ð n n n n 
As 5 ay) > ayx, + > ân Xi 
à OX, i-1j-71 j=l i=l 

—x Ax = : = : 
ox ð n n n n 
2(5 2; ay) > ax; + > Gin Xi 
OX, Niei jar jut im} 
= Ax + A’x 
which is Equation (A-20) 
If matrix A is a real symmetric matrix, then 
ð : 
A^ =2Ax,  ifA- AT 
(c) For a Hermitian matrix A, we have 
x*Ax = D XajXix, 
i-1je1 
and 


ð n n E n 
HE Ens) È ayx 
put 
= E = Ax 


"- 
2 Anj Xj 


i=l 


af(2 n - 


which is Equation (A-21). 
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Note that 
à n n - n _ 
2z($ Ens) XaaX; 
ð 1 i=1j=1 i=l . 
arx - : - : = ATX 
à n n _ n _ 
x (3 > asz) 5 Ain Xi 
n \i=1j=1 im1 
Therefore, 
Z xtax = A*x = Ax 
Problem A-8 
For ann X m complex matrix A, a complex n-vector x, and a complex m-vector y, show 
that 
ð * 
(a) ox AY = AY 
ð T- 
(b) ay AY = A’X 
Solution 
(a) Notice that 
x*Ay = > > aijXiy; 
i-1je1 
Hence, 
ð n m _ m 
F3 2 2 ay.) 2 ayy; 
à iij im, 
one AY = n E = m : = Ay 
ð - 
OX (3 2 «xs = Anj Yj 
n \i=1 j=} j=l 
which is Equation (A-24). 
(b) Notice that 
ð n m _ n _ 
2($ > — > an Xi 
à IN jo i-i 
a = : = : = ATX 
ð n m n _ 
¿(š EM D ain Fi 
m \i=1 j=l iml 


which is Equation (A-25). 
Similarly, for an n X m real matrix A, a real n-vector x, and a real m-vector y, 
we have 


KA T = 2 T = AT 
pu Ay 7 Ay, Pu Ay = A’x 
which are Equations (A—22) and (A—23), respectively. 


Problem A-9 


Given two n X n matrices A and B, prove that the eigenvalues of AB and those of BA 
are the same, even if AB + BA. 
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Solution First, we shall consider the case where A (or B) is nonsingular. In this case, 
JAI — BA| = |AI - A" (AB)A| = |A "(AI — AB)A| = [A"'| AI — AB| |A| = [AI — AB| 


Next we shall consider the case where both A and B are singular. There exist n X n 
nonsingular matrices P and Q such that 


IL, 0 
Po -[5 o] 
where I, is the r x r identity matrix and r is the rank of A, r < n. We have 


JAI - BA| = AI — Q^ BAQ] = [AI - Q^ BP"! PAQ] 


_ [Gu Goll L oí 
= Jax [$ e | 


where 
- - Gu G 
1 P 1 = 11 12 
Q B le Gn 
Then 
| _ pa hr [Gu 9] = [n c6 0 
| JAI - BA = jal le | t ams 
= AI, — Gi||AL,-.| 
Also, 


[AI — AB| = |AI — PABP™’| = |AI — PAQQ ' BP | 
- |L 9|[Guiu Gr 
i la l. oe Se] 
- [Gu Gy 
= ax | 0 0 | 


= d = Gi -Gy 
0 Aln- 


= AI, — Gil [AL] 


Hence, we have proved that 
JAI — BA| = |AI — AB] 


or that the eigenvalues of AB and BA are the same regardless of whether AB = BA or 
AB + BA. 


Problem A-10 


Show that the following 2 x 2 matrix A has two distinct eigenvalues and that the 
eigenvectors are linearly independent of each other: 


_{1 1 
a= [o 1 
Solution The eigenvalues are obtained from 


A-1 -1 
0 A-2 


Then normalize the eigenvectors. 


Ar- Al = | |l-à-00-2-0 
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as 


A =1 and À2 


li 
N 


Thus, matrix A has two distinct eigenvalues. 
There are two eigenvectors x, and x; associated with A, and A2, respectively. If 


we define 
Xu X12 
x = Xx = 


then the eigenvector x, can be found from 
AX; = À1Xi 
or 
(Ail - Ay = 0 
Noting that A, = 1, we have 


Ls ale HG 


X11 7 arbitrary constant and Xn = 0 


which gives 


Hence, eigenvector x, may be written as 


= []- [a] 
where c, * 0 is an arbitrary constant. 
Similarly, for the eigenvector x;, we have 
AX: = A2X2 
or 
(àI — A)x2 = 0 
Noting that A; = 2, we obtain 


s aall L 


Xi— X270 


from which we get 


Hence, the eigenvector associated with A; = 2 may be selected as 


x c 
X = 12 - 2 
xa C2 


where c; * 0 is an arbitrary constant. 
The two eigenvectors are therefore given by 


x, = s and x, = [e] 


The fact that eigenvectors x, and x are linearly independent can be seen from the fact 
that the determinant of the matrix [xı x2] is nonzero: 
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Ci C2 
0 C2 


To normalize the eigenvectors, we choose c, = 1 and c; = yv2, or 


#0 


Clearly, the absolute value of each eigenvector becomes unity and therefore the 
eigenvectors are normalized. 


Problem A-11 
Obtain a transformation matrix T that transforms the matrix 
0 1 0 3 
_{O -1 1 1 
^7lo o 0 1 
0 0-1 -2 


into a Jordan canonical form. 


Solution The characteristic equation is 


A -1}0 -3 
á O At dal 1 | ie -1 |^ -1 
MICAT. QA Cd 0 atill1 A42 
0 O11 A42 


Hence, matrix A involves eigenvalues 
Ai = mai À2 = -1, A3 = -1, Ag =0 


For the multiple eigenvalue —1, we have 


-1 -1 0 -3 

|0 0-1 -1 
àI- A= 0 0 -1 -1 
0 0 1 1 


which is of rank 2, or rank (4 — 2). From the rank condition we see that there must be 
two Jordan blocks for eigenvalue —1, that is, one p, X pı Jordan block and one p; X p; 
Jordan block, where p, + p; = 3. Notice that for p, + p; = 3 there is only one combi- 
nation (2 and 1) for the orders of p, and p2. Let us choose 


Pi =2 and | p;-1 


Then there are one eigenvector and one generalized eigenvector for Jordan block Jp 
and one eigenvector for Jordan block J,;. 

Let us define an eigenvector and a generalized eigenvector for Jordan block Jp 
as Vi: and v, respectively, and an eigenvector for Jordan block J,2 as vz. Then there 
must be vectors vii, Vi2, and v»; that satisfy the following equations: 


(A = Ài Dvn = 0, (A A Ai Dva =0 
(A —Ài Dviz = Vi 
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For A, = —1, A — AI can be given as follows: 
11 0 3 
_{0 0 1 1 
A-A T= 00 1 1 
00 -1 -1 

Noting that 

11 -21 
a 2_10 0 00 
A-D =o 9 op 
00 00 


we determine vector vız to be such that it will satisfy the equation 
(A =, Ai Iva =0 


and at the same time will make (A — A, I)vı2 nonzero. An example of such a generalized 
eigenvector vi; can be found to be 


v=] 9 | a = arbitrary nonzero constant 


The eigenvector vi; is then found to be a nonzero vector (A — AiDviz: 
2a 
vu = (A - à I)vz = 
~a 


Since a is an arbitrary nonzero constant, let us choose a = 1. Then we have 


2 -1 
1 0 
Vii = 1 and Vi2 — 0 
-1 1 
Next, we determine v2; so that v2, and vi; are linearly independent. For v2, we 
may choose 
b + 3c 
Vo = -b 
21 c 
—c 


where b and c are arbitrary constants. Let us choose, for example, b = 1 and c = 0. 
Then 


Clearly, vi, vi2, and vz are linearly independent. Let us define 


Vu = X, Vi2 = X2, Va = X3 
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and 
2 -1 1 
TQ) -[vnivuiva]-[uimix]-| | Q 1 
=f 1 0 


For the distinct eigenvalue A, = 0, the eigenvector x, can be determined from 


(A — à Dx, = 0 
Noting that 
0 1 0 3 
.4.10-1 1 1 
A-AI=A= 000 1 
0 0 -1 -2 
we find 
d 
_|0 
» 70 
0 
where d # 0 is an arbitrary constant. By choosing d = 1, we have 
1 
_. _|0 
TA) = x. = | 9 
0 
Thus, the transformation matrix T can be written as 
2-1 1 1 
E ‘ |1 0-10 
Then -1 1 00 
0 0 10170 1 0 3 2 -1 1 1 
aan 10 O 1 1170 -1 1 1| 1 0-10 
T AT-'9 -1 19/0 0 0 iff 1 0 00 
1 1 -2 1JL0 0 -1 -2jL-1 1 00 
-1 1: 00 
0 -1i 00 ; 
-[$ oi-il0|^ diag [J;( ^ 1), J.(—1), J.(0)] 
0 0 010 
Problem A-12 


Assume that an n X n normal matrix A has a k-multiple eigenvalue A,. Prove that the 
rank of A — Ailis n — k. 


Solution Suppose that the rank of A — A, Lis  — m. Then the equation 


(A - AADx = 0 (A-41) 


App.A Example Problems and Solutions 677 


will have m linearly independent vector solutions. Let us choose m such vectors so that 


they are orthogonal to each other and normalized. That is, vectors xi, x, .. . , Xm will 
satisfy Equation (A~41) and will be orthonormal. 
Let us consider n — m vectors Xm+1,Xm+2,---,X, Such that all n vectors 
X1,X2, ..., Xn 


will be orthonormal to each other. Then matrix U, defined by 


is a unitary matrix. 
Since for 1 = i = m, we have 


AX; = Ai Xi 


and therefore we can write 


or 


Noting that 
Ax; — Axi? = (A — ADx,, (A — ADx) 
= ((A* — AD(A — ADx:, x.) 
= ((A — AD(A* - A Dx: x) 
= ((A* — ADx;, (A* — ADx)) 
= |A*x; — Axdf 


we have 


Therefore, we can write 


Ci 
Or 
Aib, Bi 
*A*T] = 
we [ite B] 
Hence, 


Alm B| pear wanne S | ls. Bilt [Ants 0 
re d U*AU = (U*A*U)* =| V" Gl =] Br c 


Comparing the left and right sides of this last equation, we obtain 


B=0 
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Hence, we get 


pj lim 9 
A= o| 0 elo 
Then 
ype) (Ai 7 As 0 n 
A =u] 0 C - AL. U 


The determinant of this last equation is 
JA — All = (Ai ~ A)"|C - AL.-..| (A-42) 
On the other hand, we have 


= = 0 0 * 
rank (A — A4) 2n-m — tanx fuf o c- vee | 
0 0 m m 
= Zr C-A iis] = rank (C — AiLu.) 
Hence, we conclude that the rank of C — A, I,_, is n — m. Consequently, 
IC — AL I #0 


and from Equation (A-42), A; is shown to be the m-multiple eigenvalue of |A — AI| = 0. 
Since A, is the k-multiple eigenvalue of A, we must have m = k. Therefore, the rank 
of A — Alis n — k. 
Note that, since the rank of A — A, Tis n — k, the equation 
(A = Ai Dx; =0 


will have k linearly independent eigenvectors xi, Xo, . . . , Xx. 


Problem A-13 


Prove that the eigenvalues of ann X n Hermitian matrix and of ann X n real symmetric 
matrix are real. Prove also that the eigenvalues of a skew-Hermitian matrix and of a 
real skew-symmetric matrix are either zero or purely imaginary. 


Solution Let us define any eigenvalue of ann x n Hermitian matrix A by A = a + jf. 
There exists a vector x # 0 such that 


Ax = (a + jB)x 

The conjugate transpose of this last equation is 

x*A* = (a — jB)x* 
Since A is Hermitian A* = A. Therefore, we obtain 

x*Ax = (a — jB)x*x 
On the other hand, since Ax = (a + jg)x, we have 

x*Ax = (a + jB)x*x 
Hence, we obtain 

[(@ — jB) - (a + jB)\x*x = 0 
or 
—2jgx*x = 0 
Since x*x + 0 (for x + 0), we conclude that 
B=0 


9o 
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This proves that any eigenvalue of an n x n Hermitian matrix A is real. It follows that 
the eigenvalues of a real symmetric matrix are also real, since it is Hermitian. 

To prove the second half of the problem, notice that if B is skew-Hermitian, then 
jB is Hermitian. Hence, the eigenvalues of jB are real, which implies that the eigenval- 
ues of B are either zero or purely imaginary. 

The eigenvalues of a real skew-symmetric matrix are also either zero or purely 
imaginary, since a real skew-symmetric matrix is skew-Hermitian. 

Note that, in the real skew-symmetric matrix, purely imaginary eigenvalues 
always occur in conjugate pairs, since the coefficients of the characteristic equation are 
real. Note also that an n X n real skew-symmetric matrix is singular if n is odd, since 
such a matrix must include at least one zero eigenvalue. 


Problem A-14 
Examine whether or not the following 3 x 3 matrix A is positive definite: 
22 -1 
A=| 26 0 
-1 0 1 


Solution We shall demonstrate three different ways to test the positive definiteness of 
matrix A. 


1. We may first apply Sylvester’s criterion for positive definiteness of a quadratic 
form x’ Ax. For the given matrix A, we have 


22 -1 
26 0 
-10 1 
Thus, the successive principal minors are all positive. Hence, matrix A is positive 
definite. 
2. We may examine the positive definiteness of x" Ax. Since 
22 -1 x1 
x” Ax = [x:x2x3]} 2 6 O]| x2 
-1 0 1 x2 
= 2x] + 4xix2 — 2x1 x3 + 6x3 ox 
= (xı = xy. + Qn + 2x2)" + 2x? 
we find that x" Ax is positive except at the origin (x = 0). Hence, we conclude 
that matrix A is positive definite. 
3. We may examine the eigenvalues of matrix A. Note that 


JAI — A| = A? — 9A? + 15A - 2 
= (A — 2)(A — 0.1459)(A — 6.8541) 


2 2 
2>0, 2 6| > 9 >0 


Hence, 
Ai = 2, À; = 0.1459, à; = 6.8541 
Since all eigenvalues are positive, we conclude that A is a positive definite matrix. 


Problem A-15 
Examine whether the following matrix A is positive semidefinite: 


NAN 
ON 
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Solution In the positive semidefiniteness test, we need to examine the signs of all 
principal minors in addition to the sign of the determinant of the given matrix, which 
must be zero; that is, [A] must be equal to 0. 

For the 3 x 3 matrix 


âi Gi di 

23 022 Ay 

a31 32. 033 
there are six principal minors: 


Gui a3 
[588 71 


an Ax 
a32 d33 


41 dp 


au, 022, 35, , 


1 dl 


We need to examine the signs of all six principal minors and the sign of |A]. 
For the given matrix A, 


ar 1 > 0 
amy =4>0 
033 = 0 
ân an = 1 2 = 
21 ax 2 4 
A22 5| — 4 2 — 
a32 433 d2 Ol 4<0 
ân Aya] _ 1 1 a 
az 33 ^ ho 1<0 
an a2 das 12 1 
231 022 023| = 2 4 2|- 
43, 032. 403 120 


Clearly, two of the principal minors are negative. Hence, we conclude that matrix A 
is not positive semidefinite. 

It is important to note that, had we tested the signs of only the successive principal 
minors and the determinant of A, 


121 
242 
120 


we would have reached the wrong conclusion that matrix A is positive semidefinite. 
In fact, for the given matrix A, 


A-1 -2 -1 
-2 A-4 -2 
-1 -2 A 


= (A — 5.8541)A(A + 0.8541) 
and so the eigenvalues are 
Ai = 5.8541, A2=0, As = —0.8541 


For matrix A to be positive semidefinite, all eigenvalues must be nonnegative and at 
least one of them must be zero. Clearly, matrix A is an indefinite matrix. 


1 2| = _ _ 
1>0, HERD nE -0 


|AI — Al = = (A? — 5A —5)A 


Appendix B 


z Transform Theory 


B-1 INTRODUCTION 


This appendix first presents useful theorems of the z transform theory that were not 
treated in Chapter 2. Then we discuss details of the inversion integral method for 
finding the inverse z transform. Finally, we present the modified z transform 
method. At the end of this appendix (in the Example Problems and Solutions 
section), we discuss some of the interesting problems dealing with the z transforma- 
tion, not treated in Chapter 2. 


B-2 USEFUL THEOREMS OF THE z TRANSFORM THEORY 


In this section we present some of the useful theorems of the z transform theory that 
were not discussed in Chapter 2. 


Complex Differentiation. In the region of convergence a power series in z may 
be differentiated with respect to z any number of times to get a convergent series. 
The derivatives of X(z) converge in the same region as X(z). 

Consider 

X(z) = > x(k)z* 
k=0 
which converges in a certain region in the z plane. Differentiating X(z) with respect 
to z, we obtain 


ITXC) = X (Wale 
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Multiplying both sides of this last equation by —z gives 


-z4 XQ) E È kele (B-1) 
Thus, we have 
Z[kx(k)] = -2 2 XQ) (B-2) 


Similarly, by differentiating both sides of Equation (B-1) with respect to z, we have 
d UE d = : — 2 -k-1 
aj z £x) = 2 k?)x(k)z 
Multiplying both sides of this last equation by —z, we obtain 
ey rs = 3 Bx(k\e-t 
zal ixo) = 2k x(k)z 


or 
2 
Z[k?x(k)] = (-24) X(z) 


2 
The operation 3 implies that we apply the operator -z4 twice. Similarly, 


by repeating this process we have 


d m 
Z[k" x(k)] = (-24) X(z) (B-3) 
Such complex differentiation enables us to obtain new z transform pairs from the 
known z transform pairs. 
Example B-1 
The z transform of the unit-step sequence 1(K) is given by 


ZUW] = 


Obtain the z transform of the unit-ramp sequence x(k), where 
x(k) =k 


by using the complex differentiation theorem. 


: d 1 z^ 
Z [x(k)] = Z[k] = Z[k - 1(k)] = “u-z 0-33 
Complex Integration. Consider the sequence 
x(k 
a(k) = 509 


where x(k)/k is finite for k = 0. The z transform of x(k)/k is given by 
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22) - [3e dz, + lim 02 (B-4) 


k>0 


where Z[x(k)] = X(z). 
To prove Equation (B-4), note that 


[2] - aie 320), 


k=0 


Differentiating this last equation with respect to z yields 

4 Gz) = -Y xt = -2' Y x()z* = - 

dz k=0 k=0 z 
Integrating both sides of this last equation with respect to z from z to œ gives 

ys = G(@) - Gl) = - [ 3&2 
f dz G(z)dz = G(%) - G(z) = s dz, 
or 
G(z) = | XC) as, + G(») 
z 1 
Noting that G() is given by 
ài = = 1m XO 
G(») = lim G(z) = g(0) = lim, 

we have 


fet] = fg, ust 


Partial Differentiation Theorem. Consider a function x(t, a) or x(kT, a) that 
is z-transformable. Here a is a constant or an independent variable. Define the z 
transform of x(t,a) or x(kT,a) as X(z,a). Thus, 


Z[x(t,a)] = Z[x(kT, a)] = X(z,a) 


The z transform of the partial derivative of x(t, a) or x(kT, a) with respect to a can 
be given by 


z[ 2x. a)| = z|2xer. 2 - zx. a) (B-5) 


This equation is called the partial differentiation theorem. 
To prove this theorem, note that 


2|2 x(t, a)| = z|2xor. a)| = Xia. 


= — ~k n 
2S xT, a)z < x(z,a) 


Example B-2 
Consider 
x(t,a) =e 
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Obtain the z transform of this function x(t,a) by use of the partial differentiation 
theorem. 
Notice that 
ô Ks ius 
—(-t at = t at 
x (te) = re 
and 


Te "z^ 


Z [te "] = U- erz ý 


Then we have 


£ [x(t,a)] = Z [^ e^] -z[2ce»| 


-2| Tz 
ða (1 n e Tz ly 
_ Te (1 + e" Tz)! 
= (1 = e zy 
Real Convolution Theorem. Consider the functions x,(t) and x,(t), where 
x(t) = 0, fort <0 
x(t) = 0, fort <0 


Assume that x,(t) and x,(t) are z-transformable and their z transforms are X,(z) and 
X,(z), respectively. Then 


X,(z)X(z) =Z > x(hT)x(kT — «| (B-6) 


This equation is called the real convolution theorem. 
To prove this theorem, notice that 


z| » x\(AT)x(kT = &n| (hT)x(kT = hT)z* 


* k 
=> Dx 
k=0h=0 
= X Ex(hT)(KkT — hT)z* 

k=0h=0 
where we used the condition that x,(kT — hT) = 0 for h >k. Now define 
m = k — h. Then 


w% 


z| $ ah Tek - «| = X x (HT) > x(mT)^" 


Since x,(mT) = 0 for m « 0, this last equation becomes 
k w% w 
z| © x(hAT)x«kT - «| = Y x(hTz^ Dd x(mTz"-X()XXz) 
h-0 h-0 m=0 
Complex Convolution Theorem. The following, known as the complex convo- 


lution theorem, is useful in obtaining the z transform of the product of two sequences 
x,(k) and x(k). 
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Suppose both x;(k) and x,(k) are zero for k < 0. Assume that 
X)-7Z[pa(k), |z| >R, 
X,(z) = Z[x(k)], |z| >R 


where R, and R, are the radii of absolute convergence for x,(k) and x(k), respec- 
tively. Then the z transform of the product of x(k) and x,(k) can be given by 


ZA] = 54 17 x97 2) ae (B-7) 


where R, < |Z| < [z|/R,. 
To prove this theorem, let us take the z transform of x,(k)x,(k): 


Zpa(k)xX(K)] = X xi(k)xa(k)z ~ (B-8) 


The series on the right-hand side of Equation (B-8) converges for |z| > R, where 
R is the radius of absolute convergence for x,(k)x2(k). From Equation (2-23), we 
have 


1 - 
x(k) = 35$ x07 !dz 


= 35) xx a (B-9) 


Substituting Equation (B-9) into Equation (B-8), we obtain 
1 « - - 
ZIAK] = 255 Y.4 XO alk) dt 
T] k=0°C 


Noting that Equation (B-8) converges uniformly for the region |z| > R, we may 
interchange the order of summation and integration. Then 


Zis(240] = 3155 c7 x0 X 0007 2a 
Since 
E0072 = X72) 
we have 
£a(k)x(K)] = jj. E XALX z) de (B-10) 


where C is a contour (a circle with its center at the origin), which lies in the region 
given by |¢| > R, and [Z^! z| > Rj, or 


|z| 


R «WIR 


(B-11) 
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Parseval's Theorem. Suppose the z transforms of sequences x,(k) and x(k) 
are such that 


X,(z) = Z[xi(k)], |z| > R, (where R, < 1) 
X,(z) = Z[x2(k)], |z| >R 
and inequality (B-11) is satisfied for |z| = 1, or 


1 
R: < |g|< R 
Then, by substituting lz| = 1into Equation (8-10), we obtain the following equation: 
* 1 . - 
£a (Ox (uei = Lael) = 215 C X407) ag 
k=0 T] ^c 
If we set x,(k) = x(k) = x(k) in this last equation, we get 
e 1 
Ak) = —9 LU x(0)x(t»)4d 
X20 = 2$ XOX) dE 
= auf z  X(z)X(z !) dz (B-12) 
2Tj Jc 


Equation (B-12) is Parseval's theorem. This theorem is useful for obtaining the 
summation of x(k). 


B-3 INVERSE z TRANSFORMATION AND INVERSION 
INTEGRAL METHOD 
If X(z) is expanded into a power series in 2’, 
X(z) = Ex(kT)z* = x(0) + x(T)z ! + xQT)z ? + -+ + x(kT)z * + + 
k-0 

or 

X(z) = Xx(k)z* = x(0) + x(Dz! + x(2z? + t+ x(z* t 

k=0 

then the values of x(kT) or x(k) give the inverse z transform. If X(z) is given in the 
form of a rational function, the expansion into an infinite power series in increasing 
powers of z^! can be accomplished by simply dividing the numerator by the denom- 
inator. If the resulting series is convergent, the coefficients of the z * term in the 
series are the values x(kT) of the time sequence. However, it is usually difficult to 
get the closed-form expressions. 

The following formulas are sometimes useful in recognizing the closed-form 


expressions for finite or infinite series in z^ 


(1— az ! = 1 — 3az ! + 3d? — az? 


(1— az! = 1 — daz ! + 6a?z ? — Ad z ? + az * 
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(1-azb)!z-ilctaz!ctaz?ctaGz?)-az*td(z5).. lz| » 1 
(17227)? = 1 + az" + 3dz ? + 4d z ? + Satz 4+ baz +., |z| 51 
(1 — az)? = 1 + 3az7! + 6a?z~? + 108? 2?  15az * 

+ 21a°z75 28262 54 «-. lz} >1 
(1 — az) * = 1 + Maz! + 10à?z ? + 208 z? + 35a*z74 

+ 56a°z~> 8446275 + 120a z7 + - lz| 21 


For a given z transform X (z), if a closed-form expression for x(k) is desired, 
we may use the partial-fraction-expansion method or the inversion integral method 
discussed in what follows. 


Inversion Integral Method. The inversion integral method, based on the 
inversion integral, is the most general method for obtaining the inverse z transform. 
It is based on complex variable theory. (For a rigorous and complete derivation of 
the inversion integral, refer to a book on complex variable theory.) In presenting 
the inversion integral formula for the z transform, we need to review the residue 
theorem and its associated background material. 


Review of Background Material in Deriving the Inversion Integral Formula. 
Suppose zo is an isolated singular point (pole) of F(z). It can be seen that a positive 
number r, exists such that the function F(z) is analytic at every point z for which 
0 < |z — zo| = rı. Let us denote the circle with center at z = Zo and radius r; as I. 
Define I; as any circle with centeratz = zy and radius |z — zo| = r; for which r; = rj. 
Circles I; and I, are shown in Figure B-1. Then the Laurent series expansion of F(z) 
about pole z = zo may be given by 


oo 


F(z) = XSa(z-zy- Pn 


n=0 n=1 (z = Zo)” 
where coefficients a, and b, are given by 
1 $ F(z) 
= 8 ee =0,1,2,... 
aa 2nj " (z = mye E des 


1 F(z) 


b, = ani dz, n= 1,2,3,... 


7 2nj r,(z = Zo) 


Figure B-1 Analytic region for 
function F(z). 
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9 Figure B-2 Analytic region for 
function F(z) as bonded by closed 
curve I. 


Notice that the coefficient b, is given by 
- i$ 
bi 2aj Jr, F(z) dz (B-13) 


It can be proved that the value of the integral of Equation (B-13) is unchanged if 
T, is replaced by any closed curve T around zo such that F(z) is analytic on and inside 
T except at pole z = zo (see Figure B-2). The closed curve I may extend outside the 
circle T}. Then, by referring to the Cauchy-Goursat theorem, we have 


$ F(z) dz - $ F(z)dz = 0 
r D 
Thus, Equation (B-13) can be written as 
1 
b = suf F(z) dz 
H 2mj T (z) 


The coefficient b, is called the residue of F(z) at the pole zo. 
Next, let us assume that the closed curve I enclosed m isolated poles 
21,22,... , Zm, aS Shown in Figure B-3. Notice that the function F(z) is analytic in 


ET 


B-3 Closed curve I enclosing 
m isolated poles zi, Z2,...»2m- 
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the shaded region. According to the Cauchy-Goursat theorem, the integral of F(z) 
over the shaded region is zero. The integral over the total shaded region is 


F(z)dz — 9 F(z)dz — € F(z)dz —...— $9 F(z)dz - 0 
fry: - $ Fedr- $ ra -=$ Fedez 
where I1, D, . . . , In are closed curves around the poles 2,,25,. .., Zm, respectively. 
Hence, 
$ F(z) dz =$ F(z)dz +$ F(z)dz * --- +$ F(z) dz 
r T, D Im 
= 2mj(bi, Tt bi, +e + bin) 
= 2mj(Ki + Kı + +++ K,) (B-14) 
where K, = b,, K; = b... Km = b,, are residues of F(z) at poles z4, z2,... ;Zm; 
respectively. 


Equation (B-14) is known as the residue theorem. It states that if a function 
F(z) is analytic within and on a closed curve I, except at a finite number of poles 
21,22,...,Zm inside I’, then the integral of F(z) taken counterclockwise around I 
is equal to 27j times the sum of the residues at poles 21,25, ..., Zm. 


Inversion Integral for the z Transform. We shall now use the Cauchy-Goursat 
theorem and the residue theorem to derive the inversion integral for the z transform. 
From the definition of the z transform, we have 


e 


X(z) = X x(kT)z-* = x(0) + x(T)z! + zQT)z? + +--+ + x(kT)z * +- 


k=0 
By multiplying both sides of this last equation by z*-!, we obtain 
X(z)2^" = x(O)z*  x(T)z^? + xQT)z? + --- + x(KT)z + -> (B-15) 


Notice that Equation (B-15) is the Laurent series expansion of Xi (z)z*"! around 
point z = 0. 

Consider a circle C with its center at the origin of the z plane such that all poles 
of X(z)z*"! are inside it. Noting that the coefficient x(kT) associated with the term 
z^! in Equation (B~15) is the residue, we obtain 


x(kT) = anf. X(z)z""'dz (B-16) 


Equation (B-16) is the inversion integral for the z transform. The evaluation of the 
inversion integral can be done as presented next. 

Let us define the poles of X(z)z*"! as z4, 223, . . . , Zm. Since the closed curve C 
encloses all poles z;,z2,...,2n, then referring to Equation (B-14) we have 


$2) dz - $ X(z)z* ! dz +$ X(z)z dz +--+ + $ X(z)z*"! dz 
[o €i C2 Cm 


= 2nj(Ki + Ky +--+ + Km) (B-17) 


where K,, K2,..., Km denote the residues of X(z)z*~! at poles z;,Z2,..., Zm, respec- 
tively, and C, C,,..., C, are small closed curves around the isolated poles 
21,22... , Zm, respectively. 
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Now we combine Equations (B-16) and (B-17) to obtain a very useful result. 
Since X(z)z* ! has m poles, that is, 21, Z2, .. ., Zm, 


x(k) = x(kT) = K, + Ko + ttt + Km 
= Y [residue of X(z)z*"! at polez = z;of X(z)z*"] (B-18) 
i21 


In evaluating residues, note that if the denominator of X(z)z* ! contains a simple 
pole z = z; then the corresponding residue K is 


K = lim[(z — z)X(z)z* !] 
If X(z)z*"! contains a multiple pole z; of order q, then the residue K is given by 
_ 1 " dt} q k-1 
K= (q — pilin gale zj) X(z)z ] 


Note that in this book we treat only one-sided z transforms. This implies that 
x(k) = 0 for k < 0. Hence, we restrict the values of k in Equation (B-17) to the 
nonnegative integer values. 

If X(z) has a zero of order r at the origin, then X(z)2* ! in Equations (B-17) 
will involve a zero of order r + k — 1 at the origin. If r = 1, thenr + k — 1 = Ofor 
k = 0, and there is no pole at z = 0 in X(z)2* !. However, if r = 0, then there will 
be a pole at z = 0 for one or more nonnegative values of k. In such a case, separate 
inversion of Equation (B-17) is necessary for each of such values of k. 

It should be noted that the inversion integral method, when evaluated by 
residues, is a very simple technique for obtaining the inverse z transform, provided 
that X(z)z*"! has no poles at the origin, z = 0. If, however, X(z)z* ! has a simple 
pole or a multiple pole at z = 0, then calculations may become cumbersome and the 
partial-fraction-expansion method may prove to be simpler to apply. 


Comments on Calculating Residues. In obtaining the residues of a function 
X(z), note that, regardless of the way we calculate the residues, the final result is 
the same. Therefore, we may use any method that is convenient for a given situation. 
As an example, consider the following function X(z): 

22? + Sz € 6 4z + 5 
(z +1) (z*1y z+1 
We shall demonstrate three methods for calculating the residue of this function X(z). 


X(z) = 


Method 1. The residue of this function may be obtained as the sum of the 
residues of the respective terms: 


[Residue K of X(z) at pole z = —1] 


^6 — Di lim & ac + 1) 


*glgm T)! li mie + Yeap | + jim Je t1—— zl 


=i! lim (4) + lim (4) + lim (5) = 2+4+5 
=11 


2z? + 5z + s| 
(z + 1) 
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Method 2. If the three terms of X(z) are combined into one as shown next, 


x _ 227+ 52 +6 4z 5. _ iz? + 192 + 11 
@) = “Gap +i z41 (z 4 1y 


then the residue can be calculated as follows: 
[Residue K of X(z) at pole z — —1] 


2001 ,. d 311z? + 19z + 11 
TO Dae le TU E AY | 
= } lim (22) 


= 11 
Method 3. If X(z) is expanded into usual partial fractions as shown next, 
liz? + 19z + 11 3 3 11 
lO? = OOO OOH ———— 
Ae) (z +1% (z+1 (z+1P z+1 


then the residue of X(z) is the coefficient of the term 1/(z + 1). Thus, 
[Residue K of X(z) at pole z = —1] = 11 


B-4 MODIFIED z TRANSFORM METHOD 


The modified z transform method is a modification of the z transform method. It 
is based on inserting a fictitious delay time at the output of the system, in addition 
to the insertion of the fictitious output sampler, and varying the amount of the 
fictitious delay time so that the output at any time between two consecutive sampling 
instants can be obtained. 

The modified z transform method is useful not only in obtaining the response 
between two consecutive sampling instants, but also in obtaining the z transform of 
the process with pure delay or transportation lag. In addition, the modified z 
transform method is applicable to most sampling schemes. 

Consider the system shown in Figure B—4(a). In this system a fictitious delay 
of (1 — m)T seconds, where 0 = m = 1 and T is the sampling period, is inserted at 
the output of the system. By varying m between 0 and 1, the output y(t) at 
t = kT — (1 — m)T (where k = 1,2,3,...) may be obtained. Noting that G" (s) is 
given by 


G*(s) = L[g(t)dr()] 
we define the modified pulse transfer function G(z,m) by 
Z ml G(s)] = G(z,m) = G*(s,m)|,-wn Inz 
= [gt — (1 — m)7)6r(1)]-c wz —(B-19) 


where the notation Z „ signifies the modified z transform. 
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(b) 
Figure B-4 (a) System with a fictitious delay time of (1 — m)T sec; (b) modified 
pulse-transfer-function system with input X(z) and output Y(z, m). 


Noting that 
$[g(t - (1 — m)T)ôr(t)] = Ligt - T + mT)éx(t)] 
= e? 9[g(t + mT)&r()) 
we have 
G*(s,m) = e" $[g(t + mT)6r(t)] (B-20) 


Since [g(t + mT)ó;(t)] is the Laplace transform of the product of two time func- 
tions, by referring to Equation (3—19) it can be obtained as follows: 


sig + m0) = 35 [^ Go 


To ete P (B-21) 
The integration on the right-hand side of Equation (B-21) can be carried out in a 
way similar to that discussed in Section 3-3; that is, the convolution integral can be 
integrated in either the left half-plane or the right half-plane. 
Let us consider the contour integration along the infinite semicircle in the left 
half-plane. Then 


S[g(t + mT)&;(t)] = Dd residue of So at pole of ec) (B-22) 


Hence, from Equations (B-19), (B-20), and (B-22), we obtain the modified z 
transform of G(s) as follows: 


mTs 
G(zom)- z^! residue of “see at pole of sc) (B-23) 


Note that the modified z transform G(z,m) and the z transform G(z) are related 
as follows: 


G(z) = lim zG(z, m) (B-24) 
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Referring to Figure B-4(b), the output Y (z, m) is obtained as follows: 
Y(z,m) = G(z,m)X(z) (B-25) 


As in the case of the z transform, the modified z transform Y(z,m) can be expanded 
into an infinite series in z~', as follows: 


Y(z,m) = y(m)z ! + yi(m)z? + y(m)z> + ++: (B-26) 
By multiplying both sides of Equation (B-26) by z, we have 
zY(z,m) = yom) + yi(m)z ! + y(m)z ? + --- (B-27) 


where y,(m) represents the value of y(t) between t — kT and t= (k + 1)T 
(k = 0,1,2,...), or 


yk(m) = y((k + m)T) (B-28) 
Note that if y(k) is continuous then 
lim yu—s(m) = lim y,(m) (B-29) 
m1 m 


The left-hand side of Equation (B-29) gives the values y(0—), y(T—), y(2T-),..., 
and the right-hand side gives the values y(0+), y(T-), y(2T*),.... If the output 
y(kT) is continuous, then y(kT—) = y(kT+). 


Example B-3 
Obtain the modified z transform of G(s), where 


66) = 13 
Referring to Equation (B-23), we obtain the modified z transform of G(s) as 
follows: 
G(z,m) = z^!| residue of loe at pole s = —a 
? staz—en™P 
1 e"^z 
=z di + 
Z [im lc ur *taz- a 
24 emt, - e "T. 
7 y-e7 1- ez] 
Example B-4 


Consider the systems shown in Figures B-5(a) and (b). Obtain the output Y(z , m) of 
each system. 
For the system shown in Figure B-5(a), we have 


Y(z,m) = Z,[Y(s)) = Ga(z,m)Gi(z)X(z) 
Note that 
Y(z) = Z[Y(s)] = Gaz)Gi(z)X(z) 
For the system shown in Figure B-5(b), we have 


Y(z, m) = Z ,[Y(s)] = Gi Go(z,m)X(z) 
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X(s) Jo xs Yis) 
ôr Xz) ôr 


ôr Yum 


(a) 


— 
ôr Yiz, m) 


(b) 


Figure B-5 (a) System with a sampler between G,(s) and G,(s); (b) system with 
no sampler between G,(s) and G,(s). 


where 
Gi Gz, m) = Z m{Gi(s)G2(s)] 
Note that 
Y(z) = GGx(2)X(z) 
Example B--5 


Consider the system shown in Figure B-6. Obtain the modified z transform of C(s). 
The output C(z) is given by 
G(z) 


c = Ty GH@ 0 
The modified z transform of C(z) is given by 
_ _G(z,m) 
C(z,m) = Tt GH) AO) (B-30) 


Figure B-6  Closed-loop control system. 
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Example B—-6 


Consider the system shown in Figure B-7. The sampling period T is 1 sec. or T = 1. 
Suppose that the system is subjected to a unit-step input. Obtain c,(m) for m = 0.5 and 
k = 0,1,2,...,9. Also, verify that Equation (B-24) holds true. The modified z trans- 
form of G(s) is obtained from Equation (B-23) as follows: 


G(z,m) » z^ Y resi of SENTZ at pole of Eo] 


-2z'(- e| | residue of i Rs at double pole s — o| 


s(s*1)z- 


MN EE c iesim le pole s = —1 
s(stlz-e pep 


ce cen cd 1 |a 1 e" z 
mob omg tD- e 


, 1 e"*z 
Tam [e 2 s(st1)z- e) 
mz -mz -z +2z e™z 
(z -17 zoe 
_(m-1)z™ + (2 -m)z? N e€"z (1—2)) 
"s 1-z! ]-e'z^ 
(m — 1 + e77)z7! + (2.3679 — 1.3679m — 2e-”)27? 
3 + [-0.3679(2 — m) + e"]z>? 
(1 — z^») - 0.367927) 
Referring to Equation (B-30) and noting that R(z) = 1/(1 — z^!), we have 
G(z,m) 1 
1+ G(z)1-2z" 
(m — 1 + e^")z ^ + (2.3679 — 1.3679m — 2e^")z? 
+ (—0.7358 + 0.3679m + e ")z? 
1 — 2z^ + 1.63212 ? — 0.63212? 


+ residue of 


-2z(1-2) 


C(z,m) = 


Hence, for m = 0.5 we have 


0.1065z ' + 0.4709 7 + 0.05468z ^ 
— 2z' ! + 1.63212? — 0.6321z ? 


C(z,0.5) == (B-31) 


————— À 


ôr 
Ciz, m = 8m lcim) 


Figure B-7 Closed-loop control system. 
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By referring to Equation (B-27), Equation (B-31) can be expanded into an infinite 
series in z~' as follows: 

C(z,0.5) = c«(0.5)z ^! + e(0.5)z ?  ex0.5)z ?  --- 
or 
zC(z,0.5) = co(0.5)  &(0.5)z ! + ex0.5)z ?  --- 


where c,(0.5) = c((k + 0.5)T) = c(k + 0.5) andk = 0,1,2,.... The values of c,(0.5) 
can easily be obtained with a digital computer. The computer solution for k = 0,1, 
2,...,9 is as follows: 


co(0.5) = c(0.5) = 0.1065 
(0.5) = c(1.5) = 0.6839 
cx(0.5) = c(2.5) = 1.2487 
c3(0.5) = c(3.5) = 1.4485 
c4(0.5) = c(4.5) = 1.2913 
cs(0.5) = c(5.5) = 1.0078 
ce(0.5) = c(6.5) = 0.8236 
c(0.5) = c(7.5) = 0.8187 
cs(0.5) = c(8.5) = 0.9302 
c(0.5) = c(9.5) = 1.0447 


These values give the response at the midpoints between pairs of consecutive sam- 
pling points. Note that by varying the value of m between 0 and 1 it is possible to find 
the response at any point between two consecutive sampling points, such as c(1.2) 
and c(2.8). 

Finally, note that 


I» = ý 1 — ex : 

G(z) = Z[G(s)) - | s s(s+ sl 
soltez’ t-e- Try 
g 0-2 -ez 


_ _0.3679z—' + 0.26427 7 
(1 - z (i - 0.367927") 


and 


inan) 0.367927! + 0.26427? 
aan (1 — z^') — 0.367927) 


Hence, 
G(z) = lim zG(z, m) 
Clearly, Equation (B—24) holds true. 


Summary. The main purpose of this section has been to present the modified 
z transform method for finding the response for any time between two consecutive 
sampling instants. It is noted that the modified z transform method can be used not 
only for such a purpose, but also for dealing with multirate sampling schemes. 
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EXAMPLE PROBLEMS AND SOLUTIONS 


Problem B-1 
Obtain the z transform of 1/k! 
Solution 
1| vl. 
z H " Pr 
21a, l, 2,1l 3, 1 
=1+z t» + 312 ta + 
= exp(z !) 
Problem B-2 
Obtain 


=(1\ _, 
= Iz 
(This series looks like the z transform of I/k, but the k sequence begins here with 1 


instead of 0.) 
Solution Since 


Brst i74 et, lz| » 1 
k=0 1-z 
by multiplying both sides of this last equation by z ?, we have 
zk = - 
k=0 1-27! 


Integrating this last equation with respect to z, we have 
2o -2 
-k-2 z 
z dz = Í ndz 
J » 1 -z 1 


or 
G -k-1 


5 = j = In (1 — 277) + constant (B-32) 
k-07 ^ 7 


where the constant in Equation (B-32) is zero. [To verify this, substitute © for z in both 
sides of Equation (B-32).] Equation (B-32) can thus be rewritten as follows: 


-k 


Yo =ma-27), k|>1 
k-1 -k 
or 


p G = -In(1 - z^), jz} >1 


Problem B-3 
The first backward difference between x(k) and x(k — 1) is defined by 
Vx(k) = x(k) — x(k — 1) 
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The second backward difference is defined by 
V*x(k) = V[Vx(k)] = V[x(k) — x(k — 1)] 
= Vx(k) — Vx(k — 1) 

and the third backward difference is defined by 

Vx(k) = V?x(k) — V?x(k - 1) 
Similarly, the mth backward difference is given by 

UV" x(k) = V" x(k) — V""x(k — 1) 
Obtain the z transforms of Vx(k), V^x(k), V* x(k), and V” x(k). 
Solution The z transform of the first backward difference is obtained as follows: 
Z[Vx(k)] = ZIx(k)] -Z [x(k - 1] 
= X(z) — z7' X(z) 
= (1 — z)X(z) (B-33) 
Since 
V? x(k) = [x(k) — x(k — 2) - [x(k - 1) - x(k - 2)] 
= x(k) — 2x(k — 1) + x(k - 2) 
the z transform of V? x(k) is 
Z[V?x(k)] = Z[x(&k)] - 2 Z[x(k — 1)] + Z[x(k - 2)) 

= X(z)-2z'X(z) + z ?X(z) 

-Q0-zyx() (B-34) 
In this way we obtain 

Z[V?x(k)] = (1 - z^? X(z) 


Notice that the operation of taking the backward difference corresponds to multiplying 
X(z) by (1 — z`’). Thus, for the mth backward difference, 


V"x(k) = V""'x(k) — UV" x(k — 1) 
we have 
Z[V"x(k) = (1 - 27°)" X(z) (B-35) 


Problem B-4 


The first forward difference between x(k + 1) and x(k) is defined by 
Ax(k) = x(k + 1) — x(k) 
The second forward difference is defined by 
A^ x(k) = A[Ax(k)] = A[x(k + 1) - x(k)] 
= Ax(k + 1) - Ax(k) 
The third forward difference is defined by 
A^ x(k) = A?x(k + 1) — A?x(k) 
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and the mth forward difference is given by 
A" x(k) = A" x(k + 1) — A"! x(k) 
Obtain the z transforms of Ax(k), A? x(k), A^ x(k), and A” x(k). 
Solution The z transform of the first forward difference is given by 
Z[Ax(k)] = Z[x(k + 1)] - Z[x(k)] 
= zX(z) — zx(0) — X(z) 
= (z - 1)X(z) - zx(0) (B-36) 
Since 
A^ x(k) = [x(k + 2) — x(k + 1)] - [x(k + 1) - x(&)] 
= x(k + 2) — 2x(k + 1) + x(k) 
the z transform of 4?x(k) is 
Z[A?x(k)] = Z[x(k + 2) — 2x(k + 1) + x(k)] 
= z? X(z) — 27x(0) — zx(1) — 2[zX(z) — zx(0)] + X(z) 
= (z — 1 X(z) - z(z — 1)x(0) — z Ax(0) (B-37) 
where Ax(0) = x(1) — x(0). The z transform of A? x(k) becomes 
Z [A^ x(k)] = Z [x(k + 3) — 3x(k + 2) + 3x(k 1) — x(k)] 
= (z — 1} X(z) - z(z — 1Yx(0) — z(z — 1) Ax(0) — z A^x(0) 


where Ax(0) = x(1) — x(0) and A?x(0) = x(2) — 2x(1) + x(0). Similarly, for the mth 
forward difference 


A" x(k) = A" x(k + 1) — A"! x(k) 


we have 


Z[A"x(k)] = (z - 1)” X(z) - z3 (z — 1)" A'x(0) (B-38) 


Problem B-5 
Solve the following difference equation: 
(k + 1)x(k + 1) - x(k) = 0 


where x(k) = 0 for k < 0 and x(0) = 1. Notice that this difference equation is of the 
time-varying kind. The solution of this type of difference equation may be obtained by 
use ofthe z transform. (It should be cautioned that, in general, the z transform approach 
to the solution of time-varying difference equations may not be successful.) 


Solution First, note that 
Z [kx(k)] = E X(z) 
dz 


Since the original difference equation can be written as 


kx(k) — x(k- 1) =0 
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the z transform of this last equation can be obtained as follows: 
d -1 = 
77 X) z'X(z)-0 
or 
2 x) + X(z) 20 
dz x 


from which we have 


dX(z dz 


Xc) 2 
or 
In X(z) = : *InK 
where K is a constant. Then X(z) can be found from 
X(z) = Kexpz^! 


Since exp z~' may be expanded into the series 


expr = 1427 + pete tet +, |z|>0 
we have 
X(z) = K |i ub ta ees 
2! 3! 


from which we find the inverse z transform of X(z) to be 
1 
x(k) = Ki, k =0,1,2,... 
Since x(0) is given as 1, we have 


x(0) = K=1 


Thus, we have determined the unknown constant K. Hence, the solution to the given 
difference equation is 


x(k) =È, k=0,1,2... 


Problem B-6 


Solve the following difference equation: 
(k + Yx(k + 1) - xk) =k +1 
where x(k) = 0 fork = 0. 


Solution First note that by substituting k = 0 into the given difference equation, 
we have 


x(1) =1 
Now define 
y(k) = kx(k) 
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Then the given difference equation can be written as 
y(k+1)-y(k)=k+1 


Taking the z transform of this last equation, we have 


2¥(@2) - 0) - ¥@) gi 
Since y(0) = 0, we have 


-2 z`! 


EAE 
Referring to Problem A-2-8, we have 


Hence, the inverse z transform of vs can be given by 
y(k) = 4(k? - K) + k = 400 + k) 
Then, x(k) for k = 1,2,3,... is determined from 
kx(k) = y(k) = 4(k? + k) 


Y(z) = 


as follows: 
x(k) = 4(k + 1), k = 1,2,3,... 
Problem B-7 


Consider the system shown in Figure B-8. The sampling period is 2 sec, or T = 2. The 
input x(t) is a Kronecker delta function &(t); that is, 


RN {i k + 0 
Obtain the response every 0.5 sec by using the modified z transform method. 
Solution Since the input x(t) is a Kronecker delta function, we have 
X(z) = 
The modified pulse transfer function G(z,m) is obtained as follows. Referring to 
Equation (B-23), 


mTs 


G(z,m) - e residue of I—- at pole s = —0. ex] 


1 e 
s + 0.6931 z — 
Noting that T = 2, we obtain 


G(z,m) = a 


TCR i 47" 
mt 
s + 0.6931 


Z pe 991—025 
G(s) 


f 1 em 
en [e + 06D, V 0 6931 zs 


$— 


y(t) 


x(t) Pd 


êr 


— 
6, Y(z,m) Figure B-8 Impulse-sampled system. 
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Hence, the output Y(z, m) can be obtained as follows: 
4" 
Y(z, m) = G(z,m)X(z) = 7— 55 
Referring to Equation (B-27), we have 
zY(z,m) = yo(m) + y(m)z ! + y4(m)z ? + --- 


where y,(m) = y((k + m)T) = y(2k + 2m). In this problem zY(z,m) can be ex- 
panded into an infinite series in z~’ as follows: 


zY(z,m) = I-A 
=4megmiz ty qm 2z 2p gm sz 34... 
Hence, 
ym) = 4" 
yi(m) = 4! 
ym) = 477 


ym) = a 


To obtain the system output every 0.5 sec, we set m = 0, 0.25, 0.50, and 0.75. For 
m = 0.25, we obtain 


yo(0.25) = y(0.5) = 4-° = 0.7071 
y:(0.25) = y(2.5) = 4^*5 = 0.1768 
y2(0.25) = y(4.5) = 4-275 = 0.04419 
yx(0.25) = y(6.5) = 4^5 = 0.01105 


y, Um) 
y, Un) = y((k + mT} - y(2k + 2m) 
1.0 e m=0 
B m=0.25 
0.8 4& m -0.50 
5 o m=0.75 
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Similarly, the values of y,(m) for m = 0, 0.5, and 0.75 can be calculated. The result 
is shown in Figure B-9 as a plot of y,(m) versus k. 


Problem B-8 


Obtain C(z,m), the modified z transform of the output, of the system shown in 
Figure B-10. 


Figure B-10  Closed-loop discrete-time control system. 


Solution From Figure B-10 we have 
E(s) = R(s) - C(s) 
M(s) = Gi(s)E*(s) 
C(s) = GXs)M*(s) 


Hence, 

M*(s) = Gi(s)E*(s) 
or 

M(z) = Gi(z)E(z) 
Also, 

E*(s) = R*(s) — C*(s) = R*(s) — Gł(s)M* (s) 
or 
E(z) = R(z) - GXz)M(z) 

Therefore, 


M(z) = G,(z)[R(z) - G2(z)M(z)] 
from which we obtain 
_ __G,(z)R(z) 
MG 11 6642 
Since C(z, m) can be given by G;(z , m)M(z), we have 
G,(z)G.(z, m) 


C(z, m) = Go(z,m)M(z) = 77 Gi(z)G2(z) 


R(z) 


Appendix C 


Pole Placement Design 
with Vector Control 


C-1 INTRODUCTION 


In Chapter 6 we presented the pole placement technique and state observer design 
when the control signal u(k) was a scalar. If the control signal is a vector quantity 
(r-vector), however, we can expect to improve the system's response characteristics, 
because we have more freedom to choose control signals u;(k), uX(K), . . . , u,(k). For 
example, in the case of the nth-order system with a scalar control, the deadbeat 
response can be achieved in at most n sampling periods. In the case of the vector 
control u(k), the deadbeat response can be achieved in less than n sampling periods. 

It is noted that with the vector control it is possible to choose freely more than 
n parameters; that is, in addition to being able to place n closed-loop poles properly, 
we have the freedom to satisfy other requirements, if any, of the closed-loop system. 

In the case of the vector control, however, the determination of the state 
feedback gain matrix K becomes more complex, as we shall see in this appendix. 


C-2 PRELIMINARY DISCUSSIONS 


Consider the system 
x(k + 1) = Gx(k) + Hu(k) (C-1) 


where 
x(k) = state vector (n-vector) at kth sampling instant 


u(k) — control vector (r-vector) at kth sampling instant 
G =n X n matrix 
H = n X r matrix 
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We assume that the magnitudes of the r components of u(k) are unconstrained. As 
in the case of the system with a scalar control signal, it can be proved that a necessary 
and sufficient condition for arbitrary pole placement for the system defined by 
Equation (C-1) is that the system be completely state controllable. 

Let us assume that the system defined by Equation (C-1) is completely 
state controllable. In the state feedback control scheme, the control vector u(k) is 
chosen as 


u(k) = -Kx(k) (C-2) 


where K is the state feedback gain matrix. It is an r X n matrix. With state feedback 
the system becomes a closed-loop system and its state equation becomes 


x(k + 1) = (G — HK)x(k) 
where we choose matrix K so that the eigenvalues of G — HK are the desired 
closed-loop poles jy, uo, . . . , Hn- 
Transforming State Equation Into Controllable Canonical Form. Consider the 
system defined by 
x(k + 1) = Gx(k) + Hi u(k) (C-3) 


where 
x(k) = state vector (n-vector) 


u(k) = control signal (scalar) 
G =n X n matrix 
H, = n X 1 matrix 


Assume that the system is completely state controllable. Then the controllability 
matrix has its inverse. Define 


f, 
where the f;’s are the row vectors. Then construct a transformation matrix T, as 
follows: 


foin 
Lee (C-4) 
f, qr 
where the f, G* are row vectors (k = 0,1,2,...,n — 1). Then it can be shown that 
f, £ | 
T/GT,- to G fe 


f, G f, Gr! 
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0 1 0 0 
0 0 1 e 0 
=|: : (C-5) 
0 0 0 1 
ân ân- 4-2 7a 
and 
0 
0 
T: 'H, =|: (C-6) 
0 
1 


[See Problem C-1 for the derivation of Equations (C-5) and (C-6).] 
Now if we define 


x(k) = Ti &(k) 
then Equation (C-3) becomes 
&(k + 1) = Ti! GT, £(K) + T;! Hiu(k) 


Or 
i(k + 1) 0 1 0 + 0] 4k) 0 
£,(k + 1) 0 0 01 oe Off ee) 0 
=|: : t +l lacy (CD 
i(k +1) 0 0 0 «+ 4 fea} lo 
£,(k + 1) TAn Tân- 704 co: TA, £,(k) 1 


We have thus shown that the state equation, Equation (C-3), can be transformed 
into the controllable canonical form by use of the transformation matrix T, defined 
by Equation (C-4). 


Design Steps. | In what follows we shall discuss the procedure for determining 
a state feedback gain matrix K such that the eigenvalues of G — HK are the desired 


values 1, 42, . . . , Mn- 
The state equation to be considered in the following was given by Equa- 
tion (C-1): 


x(k + 1) = Gx(k) + Hu(k) 


We assume that the rank of the n X r matrix H is r. This last equation is equiv- 
alent to 


where 
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The procedure for designing the state feedback gain matrix K involves the following 
two steps: 


Step 1. Extend the transformation process [the process that transforms the 
state equation given by Equation (C-3) into the state equation in the controllable 
canonical form given by Equation (C-7)] to the case where matrix H is an n x r 
matrix. That is, we transform the given state equation into a controllable canonical 
form by use of a transformation matrix T, the exact form of which will be given later. 
By defining 

x(k) = T&(k) 
the original state equation, Equation (C-1), can be transformed into 
&(k + 1) = T GT&(k) + T^! Hu(k) = G&(k) + Hu(k) (C-8) 


where G = T^! GT is in a controllable canonical form and H = T^! H. (This control- 
lable canonical form is slightly different from the usual form, as we shall see later.) 


Step 2. By use of a state feedback gain matrix K, the control vector can be 
given by 


u(k) = —Kx(k) = —KTX(k) 
and the system state equation becomes 
&(k + 1) = (6 — BKT)&(k) 


We choose matrix K so that matrix G — HKT will have the desired eigenvalues 
Mis H2 s Mn. 


C-3 POLE PLACEMENT DESIGN 


We shall first discuss the determination of a necessary transformation matrix T and 
then determine the state feedback gain matrix K. 
Consider the completely state controllable system defined by 


x(k + 1) = Gx(k) + Hu(k) (C-9) 
where 
x(k) = state vector (n-vector) 
u(k) = control vector (r-vector) 


G =n X n matrix 


We assume that the rank of matrix H is r. Thus, the component vectors Hh, 
H, . . . , H, of matrix H are linearly independent of each other. Since the system is 
assumed to be completely state controllable, the rank of the n X nr controllability 
matrix 
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is n. The controllability matrix can be written in an expanded form as follows: 


Let us choose n linearly independent vectors from this n X nr matrix. Let us begin 
from the left-hand side of this matrix. Since the first r vectors H;, H2,...,H, are 
linearly independent of each other, we choose these r vectors first. Then we examine 
GH, if it is linearly independent of the r vectors already chosen. If it is, we have 
chosen r + 1 linearly independent vectors. Next, we examine GH,, GH,,..., 
GH,,... in the order shown in the expanded controllability matrix until we find 
altogether n linearly independent vectors. (Since the rank of the controllability 
matrix is n, there always exist n linearly independent vectors.) 

Once we have chosen n linearly independent vectors, we rearrange these 
vectors in the following way: 


G""H,:---::H,:GH,:---:G"^H,] (C-10) 


The numbers n; are said to be Kronecker invariant and satisfy the equation 


ntn t:::tn-n 
We shall define the maximum of n;,75,...,n, as ny: 
Min = MAX (N1, N2,...,N,) (C-11) 


We shall refer to this equation later in the discussion of deadbeat response. Next, 
we compute F~! and define the 7; th row vector as f,, where 


T =n tmt: tn, i-1,2,...,r 
Then the required transformation matrix T can be given by 


ST 
Sz (C12) 
s, 
where 
f; 
s=| fS 
f, qr 


Notice that the transformation matrix T given by Equation (C-12) is an extension 
of the transformation matrix given by Equation (C-4). 

To simplify the presentation, in what follows we shall consider a simple case 
where n = 4 and r = 2. (In this case, only n; and n, are involved.) (Extension to 
more general cases is straightforward.) Then the transformation matrix T becomes 
a 4 x 4 matrix. The transformation matrix T given by Equation (C-12) becomes 


-1 
— | Si 
T- H 
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f, f 
Si = : » S, = : 
f, Gr f Gr! 


(Note that in the case of n = 4 there are three possibilities for the combinations of 
n and ny n = 1,m = 3; n, = 2, n; = 2; and; = 3,m = 1.) For example, ifn, = 2 
and n; = 2, then matrices G and H become, respectively, as 


where 


0 1730 0 
A pgp = [au -4n {aa aa TIMES = i 
G = T'GT = [pe Lg). iím-2m-2 (C43 
ay —ay | dos an 
and 
0 0 | 
fg m-l - 1 b» if n =” 2, n; = 2 z 
H-T'H-[c-G | (Note: by = fiGH, = 0 in this case) — (19 
0 1 


(see Problem C-2). As another example, if n; = 3 and m = 1, then 


0 1 0 !0 
0 0 1/0 


G-T'GT - ; ifn, =3,m=1 (C-15) 
rm Hg 0 Bd 
—7üaq “an 705-05 
and 
0 0 
^ 0 0 if n =3,m=1 
= T-! = 1 3762 i} 
H ue 1 bp d (Note: by = f, G H, may or (C 16) 
0 1 may not be zero) 


(see Problem C-4). In what follows, we shall focus on the case where n, = 2 and 
n; = 2. (Other cases can be handled similarly. For example, for the case where 
n, = 3and m, = 1, see Problems C-3, C-4, and C-5.) For the case where n; = 2 and 
n; = 2, matrix G = T^! GT can be given by Equation (C-13), and the characteristic 
equation is 


z -1 0 0 
^| ..|du Z tan ag a4 
ESSE." g le l 
az an an Z + ay 
z —1 z -1 | F4 -1 ü13 Qua 
Au Z t anilan Z + Ay Ay Ai |Z -1 


= (z? + âZ + an)(z? + ayz + an) = (anz + a3)(a1,z T a3) 
=0 (C-17) 
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where we have used Laplace's expansion by the minors. (See Appendix A for the 

details.) From Equation (C-17) the characteristic equation |zI - G| = 0 becomes 
^ De tai! ayzta 

\zI _ G| = Pe aed S| ee Toe 


anz + Ay |Z? + yz + ay 


=0 (C-18) 


The eigenvalues of G can be determined by solving this characteristic equation. 
Next, we shall determine the state feedback gain matrix K so that the eigen- 
values of G — HK are u, M2, ... , Mn, the desired values. Let us define a2 x 2 matrix 


B such that 
_[1 bel 
B= [4 7] 


(Note that b;; is a constant appearing in H matrix.) In the particular case where 
n; = 2and n; = 2, the value of bj; is equal to 0. Thus, B = I. For more general cases, 
matrix B may not be the identity matrix. 

Also, define a 2 x 4 matrix A such that 


ôn 82 ôs & 
A=] oO 9n ôg | i 
E ôn ôn ôn a 
Then it will be seen that matrix K can be given by 
K = BAT"! 


and the control vector u(k) can be given by 
u(k) = —BAT™'x(k) = -BA&(K) 
Thus, the system state equation given by Equation (C-8) becomes 
&(k + 1) = G&(k) — BBA&(k) = (Ô — HBA)&(k) 


For the present case, matrix HBA becomes as follows: 


0 0 D 
x 1 OV 1 0 61 62 ôs E 
HBA = 
0 0 E | Is ôn 83 ên 
0 
0 0 0 0 
= ôn Óp êz Ôu 
0 0 0 0 
ôn 82 Ó5 ôn 
Hence, 
6 a HBA _ | Tau — 61 ay — by —i3 — 613 —ay — ôa 


1 
—@y — 6j -an — ên —45— 05 -an — dy 


t. : 
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Then, referring to Equation (C-18), the characteristic equation |zI — G + HBA| 
becomes 


a AR + (ay + 82)z + ay + ôn | + Su)z a + 8 
et — Ô + Wal = Let el? tan FB tu t Suz tau + Bis 
(an + &5)z + an + by z? + (dy + Óu)z + ay + ôn 


= [z + (an + j)z t ay + uz T (ax + &4)z + az + 53] 
— [(a14 + 801)z + an + 8][(a2 + by)z + an + Su] 
=0 (C-20) 


We desire the eigenvalues of G — HBA to be Hai, bo, Ma, and py, or the desired 
characteristic equation to be 


(z — m)(Z — oo) (z — pX(z — ma) = zi + az? + Hz? + 032 + aw =0 (C-21) 
If we equate the coefficients of equal powers of z of the two characteristic equations, 
Equations (C-20) and (C-21), we obtain the following equations: 
an + ôn + an + bx = a 
an + ôn + (an + n)an + ôu) + ag + ôn — (a4 + 64)(a5 + ôn) 
(an + n)an + 524) + (an + ôn)az + ôn) 
— (an + n)an + 822) — (an + n)a + 84) = œ 
(an + 51)(@23 + 523) — (a + n)an + ôn) = a, 


Notice that we have eight ô variables and four equations. Hence, the values of ô, 
512, 055, 64, 65, 622, 523, and 524 cannot be determined uniquely. There are many 
possible sets of values ô, ô2, . . . , 03, and thus matrix A is not unique. Any matrix 
A whose elements satisfy the foregoing four equations is acceptable. 

Once matrix À is chosen, the required state feedback gain matrix K is given 
by 


a 


K = BAT"! 
and the state feedback control vector is 
u(k) = -BAT ! x(k) 
and the state equation given by Equation (C-9) becomes 
x(k + 1) = Gx(k) - HBAT ! x(k) = (G — HBAT x(k) 
As a matter of course, note that 
|G — HBAT"!| = |T-'||G — HBAT"!|[T| = |T- GT — T HBA| = |G — HBA| 


For a given set of desired eigenvalues py, 22, .. . , in, We have the correspond- 
ing coefficients o, œ, ... , a, in the characteristic equation |zI — G+ ÉBA| = = 0. 
For the given a1, 05, ..., o,, it is possible to choose a matrix A that is not unique. 


(This means that we have some freedom to satisfy other requirements, if any.) 
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If the deadbeat response is desired, we require w, = pz = u = p = 0. The 
desired characteristic equation given by Equation (C-21) becomes 


z4=0 
Notice that if we choose, for example, 
— | 74 Tän “än “au » 
A= | » " Ens a] (C-22) 


where the elements indicated by asterisks are arbitrary constants, then G — HBA 
becomes 


0 100 
^ ra IO 000 
SHBA gi 9-0 1 
ae xx 0 0 
where the elements indicated by the double asterisks are arbitrary constants. 
0 0 0 0 
^ raz |0 0 00 
(G — HBA)’ -|.. 000 
0 » 0 0 
0000 
^. finas. 0 0 0 O 
(G - HBA)’ = O s 0 0 
0000 
and 
000 0 
A i n 4 0 0 0 0 
Ie - HBAY = 6 0 o 0 
0000 


Thus, the deadbeat response is obtained. Matrix A given by Equation (C-22) is not 
unique because different choices of elements can yield the deadbeat response. 
Hence, more than one state feedback gain matrix K exists that will yield the deadbeat 
response. This is expected, since we have two control signals u,(k) and u,(k) 
available, instead of just one control signal. 

It is important to note that if we choose 


A-| Qn Tan “an anų (C-23) 
Tän Tan -ân ay 
then 
0100 
^ 1 .[000 0 
G — HBA = 0001 
000 0 
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and 
(G - HBA) = 0 

Thus, (G — HBA)* becomes zero for k = 2,3,4,.... The deadbeat response is 
achieved in two sampling periods. In fact, in general, by choosing the elements of 
A in the manner given by Equation (C-23), the deadbeat response can be achieved 
in ni, Steps rather than n steps, where 

nmin = max (Ny, N2,...,M,) 
Since n, + n; + --: +n, = n, we note that nmin is always less than n. 

Extension to the More General Case. Thus far, we have given detailed discus- 
sions for the case where n = 4 (n, = n; = 2) andr = 2. Extension of the preceding 
discussions to the more general case is straightforward. For example, consider the 
case where n = 6 and r = 3. For this case, 

ntntn- 6 


and we have several possible combinations of n,, m, and n3. 
Now consider the case where n, = 3, n; = 2, and n, = 1. The modified 6 x 6 
controllability matrix F for this case is 


F= [H, : GH, : GH;: H;: GH, : Hs] 


Define 
LEE 
boulot In =3 
F" = fA 
LI 
eh? 
f, ps =] 


where a row of asterisks denotes a row vector. Then the transformation matrix T can 
be formed as follows: 


where 


0 1 0170 030 
0 0 1:0 030 
6 = | A Te Leni caa Tas | cw 
0 0 0350 110 
TM Un Ami Hw TAs | tae 


—d4 —d3 —G33 ! 70s 735 | 7036 
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0 0 0 
0 0 0 
q- l1 5n bn 
H = 19-0 0 
91 bz 
0 0 1 


where bn = f Œ Hb, b = fı G? H;, and b» = f; GH;. These values may or may not 
be zero. (Notice that in matrix G the principal minors are in the controllable 
canonical form.) The state feedback gain matrix K is given as follows: 


K = BAT"! 
where 
1 by by =l 
B=|0 1 by 
0 0 1 
and 
bn 612 613 814 515 516 
A=] ôx 05 O5 O4 Ox Ox 
[M 532 533 534 535 536 
Notice that 
0 0 O 0 0 0 
0 0 0 0 0 0 
1 bp b 
ám. |1 Be by 12 013 100 
HB-9 o 0 A l Pas 7000 
0 1 bg 0 1 0 
0 0 1 0 0 1 


The effect of postmultiplying matrix B to matrix Å is to eliminate the bj; from the 
product matrix HB. 

Note that if u(k) is an r-vector the general form of B matrix is 
1 


1 by b, 7 
0 1 bọ» 

B=]|0 0 bs, 
0 0 1 


where the constants b;;'s are those that will appear in the n x r matrix H. (The 
elements of HB are either 0 or 1.) 


Example C-1 
Consider the system 
x(k + 1) = Gx(k) + Hu(k) 
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where 
x(k) = state vector (3-vector) 
u(k) = control vector (2-vector) 
and 
0 1 0 0 1 
G=! 0 01 |, H-|0 0 
—0.25 0 0.5 1 0 


It is desired to determine the state feedback gain matrix K so that the response to the 
initial state x(0) is deadbeat. Note that with state feedback u(k) = —Kx(k) the system 
equation becomes 


x(k + 1) = (G — HK)x(k) (C-25) 


We shall first examine the controllability matrix: 


jojo a 0 
=[{01/01; 1} 0 05 -025 
1111011051 -025 0.25 —0.125 


Clearly, the rank of this controllability matrix is 3. Therefore, arbitrary pole placement 
is possible. We now choose three linearly independent vectors starting from the left end. 
These vectors are shown enclosed by dashed lines. (The three linearly independent 
vectors chosen are H;, H;, and GH,.) Now we rearrange these three vectors according 
to Equation (C-10) and define matrix F as follows: 


F = {Hi E GH, : H;] 


We note that n, = 2 and n; = 1. 
Rewriting matrix F, we have 


0 0 1 
F=/0 1 0 
1 05 0 
The inverse of matrix F becomes 
0 -0.5 1 
F'-|0 1 0 
1 0 0 


We now define the n;th row vector of F^! as fı, where = n; and m = n, + m. Since 
ni = 2 and m = 1, the vectors f, and f; are the second and third row vectors, respec- 
tively. That is, 


f=[1 0 0] 


Next, define the transformation matrix T by 


where 
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Hence, 
010[|' 1001 
T=/0 01) 1100 
10 0 01 0 
and 
010 
T'-|00 1 
100 
With this transformation matrix T, we define 
x(k) = Tk(k) 
Then 
T'GT=6 
01 0 0 1 0 001 
=|0 0 1 0 0 1 100 
1 0 O}/ -0.25 0 0.1l[0 1 0 
01 ; 0 
=/0 0.5! -025 
1010 
Also, 
T'H-«H 
0 1 0[0 1 0 0 
-|00 17/0 0|2|]1 0 
10041 0 0 1 
Next, we determine the state feedback gain matrix K, where 


K = BAT! 
From Equation (C-24), matrix B for the present case is a 2 x 2 matrix. Noting that 


by = 0, we have 
-1 
[a ep [10 
s-|i A T ] 


For the present case, A is a 2 X 3 matrix: 


ôn ói 513 
A= 
| 85 bx E 


Now we determine matrix G — HBA: 


01 0 0 0 
6-fÉBA-|0 05 -025|-|1 JP ae i J 
1 


10 0 0 0 1||ón ôn 6825 
0 1 0 0 0 0 
-|0 05 -025|- ĝu 61; 513 
1 0 0 62 ôn 823 
0 1 0 
= — ô 0.5- 82 —0.25 v 015 


1-6, -ôx — 823 
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The characteristic equation [zI — G + HBA| = 0 is given as follows: 


z -1 0 
l1- Ĝ + BBA|- | ôn z-0.5+ 52 0.25 + 83 
—1 + 64 622 z+ bx 
=0 
Since the deadbeat response is desired, the desired characteristic equation is 
2=0 


Note that the choice of the 6’s is not unique and matrix A is not unique. Suppose we 
choose the 6’s so that 


ĉn = 0, ôn = 0.5, 6:3 = —0.25 


ôa = 1, ôn = 0, ôn = 0 
Then 
` . z -1 0 
l1-G- ĦBA| = |0 z o0oļ=z7=0 
0 0 z 
and thus 


_[o 05 -0.25 
a-|° 0 0 | 


is acceptable. Then matrix K is obtained as follows: 


010 
K= Bar =|) JE ae Pe 0 0 1 
100 


_ | 70.25 0 0.5 
0 1 0 
With this choice of matrix K, (6 - HBA) = 0 for k = main, where 


Mmin = MAX (M1, n2) = max (2,1) = 2 


In fact, 


(G — HBA)’ = 


ooo ooo 
ooo cor 
ooo coco 


Thus, 
(G- HBA)‘ = 0, £k-2,3,4,... 
Note that 
G - BBA = T"GT - T' HBA = TGT - T^ HKT = T(G — HK)T 


Referring to Equation (C-25) and its solution x(k) = (G — HK)" x(0), we have x(k) = 0 
for k = 2,3,4,..., since 
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G - HK = T(G - HBA)T™ 


App. C 


(G — HK) = T(G - HBA)T-'T(G — HBA)T™ = T(G - ÉiBAy T = 0 


and 


x(k) -(G- HK)‘x(0)=0, k=2,3,4... 


We have thus designed the state feedback gain matrix K so that the system's response 
to any initial state x(0) is deadbeat. The state x(k) can be transferred to the origin in 
at most two sampling periods. [Note that if the control signal u(k) were a scalar then 
it would take at most three sampling periods, rather than at most two sampling periods, 


for deadbeat response.] 


EXAMPLE PROBLEMS AND SOLUTIONS 


Problem C-1 


Consider the system given by 
x(k + 1) = Gx(k) + Hiu(k) 
where 
x(k) = state vector (n-vector) 
u(k) = control signal (scalar) 
G =n xX n matrix 
H, = n x 1 matrix 


Assume that the system is completely state controllable. 


Define 
f, 
[H : GH, : CUN ; G"'!H]' = fz 
fn 
where the f; ’s (i = 1,2,...,n) are row vectors. Define also 
f -1 
T, = fG 
fa, G"! 
Show that 
0 1 0 
0 0 1 
T, GT, = : 
0 0 0 


(C26) 
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and 


oo 


TH =]: (C-27) 


1 
where the a;'s are the coefficients appearing in the characteristic polynomial of G, or 
|z¥ — G| = 2" + az"! + e+ + aniz + ay 


Solution We shall prove Equations (C-26) and (C-27) for the case where n = 3. 
(Extension of the derivation to an arbitrary positive integer n is straightforward.) Thus, 
we shall derive that 


0 1 0 
T;'GT, =| 0 0 1 (C-28) 
—üs3 —-@2 ~ai 
Since 
fs 
T;' =| £6 
tG 


it is possible to rewrite Equation (C-28) as follows: 


0 1 0 f; 
T, G-| 0 0 1 |} &G (C-29) 
—ü3 “a “a f, G 
Now consider the conjugate transpose of the right-hand side of Equation (C-29). Noting 


that for physical systems the coefficients a;, 42, . . . , à, of the characteristic polynomial 
are real, we have 


0 0 —705 
[f!:G*f*:(G*Pft]1 0 -a|-[G*ft: (GM? f$: -asft — a, G*f5 — a (G*Y f] 
0 1 ~€A, 


Note that G* satisfies its own characteristic equation: 
$(G*) = (G*)’ + a(G*) + aG* + a1 = 0 


Hence, 
-[asI + a;G* + a(G*)]f$ = (G*) £3 
Consequently, 
0 0 -a 
[t5:G*f* :(G*^f1] ; = = [G*f* :(G*?f*:(G*)f5] = G*[f5:G*f5: (G*)^f5] 


Taking the conjugate transpose of both sides of this last equation, we obtain 


0 1 0 f, fs 
0 0 1 iG 
—ü3 —-@ —-a f; (ek f, G 


| 
o 
(7) 
a 
e 
pU 
a 
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which is Equation (C29). Thus, we have shown that Equation (C-28) is true, or 


0 1 0 
T,'GT-l0 0 1 


7035 —d, —üi 


Next, we shall show that 


0 
T,'H, =| 0 
1 
Since 
f, 
[H; : GH,: GH]' =| 
f, 
we obtain 
f, 
I= £ (Hi : GH, : G’ Hy] 
f, 
or 
100 fH, f,GH, f,G*H, 
0 1 0 = ft H, £;GH, LG H, 
0 0 1 LH, f;,GH, f&G'/H, 
Hence, 


tH, = 0, f; GH, = 0, f: G°H, = 


By using these equations, we obtain 


f, fH, 0 
Ti'H, = LG Hi = f; GH, = 0 
LG f G'H, 1 


Note that the extension of the derivations presented here to the case of an arbitrary 
positive integer n can be made easily. 


Problem C-2 


Consider the system 


x(k + 1) = Gx(k) + Hu(k) 


where 
x(k) = state vector (4-vector) 
u(k) = control vector (2-vector) 
and 
-1 1 00 1 0 
5-171213. mommo 2 
1 0 01 0 1 
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Referring to Equation (C-10), obtain matrix F. Then, by use of the transforma- 
tion matrix T defined by Equation (C-12), determine matrices G = T^' GT and 
H=T'H. Finally, derive Equation (C-14). 


Solution We shall first write the controllability matrix as follows: 


[H; : H2: GH, : GH, : G° H; : G° H; : G° H; : GHH;] 


aae (al pae Gd aain A came | 
i1110/;-11101 2 0 -5 2 

-[oiioibdiio| -3 2 n -4 
1011011; 0/121 3 0 -6 4 
\Oiilii litli 01 2 1 
bod bad L--- L.-i 


We now choose four linearly independent vectors from this 4 x 8 matrix, starting from 
the left end. (These vectors are shown enclosed by dashed lines.) The four linearly 
independent vectors chosen are Hi, H2, GH;, and GH;. Next, we rearrange these four 
vectors according to Equation (C-10) and define matrix F as follows: 


(Note that in this case n; = 2 and n; = 2.) Thus, 


1-100 

jlo 100 

F-lo 002 

0 111 

The inverse of this matrix is given by 

1 1 0 0 
4.10 1 0 0 
F -|o -1 -0.5 1 
0 0 050 


Since in this case n, = 2 and m = 2, we define the second row vector of F^! as f, and 
the fourth row vector as f;. Then 


f-[010 0 
t-[0 0 05 0] 


The transformation matrix T is given by 


where 
_|fi_ "m 
s-[s) [es 
Hence, 
ff’ jo 1 0 o;' 2 1-20 
T tG 1 -2 1 0| _ 1 0 00 
f 0 0 0.5 0 0 0 20 
tG 0 05 -05 1 -0.5 0 1 1 
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With this transformation matrix T we obtain 


0 1 o olf-1 1 ool2 1-20 
~ ~in,_{1 -2 1 Off 1-2 10] 1 0 00 
S-T GT-|j o osol o 1-1 21 0 0 20 
0 05 -05 1] 1 o o 1|-050 11 
0 1 00 
-1 3 22 
0 0 01 
15 15 -1 0 
and 
o 1 o ol10] foo 
à sag |1-2 1 0|[0 0| [10 
H-T H-/5 o os olo o|^|o o 
0 os -05 1| 0 1| |0 1 


Notice that, when n, = m = 2, matrix G has the form given by Equation (C-13) and 
matrix H has the form given by Equation (C-14), or 


0 1 i0 0 0 0 

^ mi T0717. !—dis ay ^ 1 by 

= | ----------- L-z. = J -----—* 

C=)-o oe :*0 i| B-^l|o'o 
1 

Az = —@x 1-23 azn 0 1 


! 
(Note that 5b,; is zero in this case.) 
Finally, we shall derive Equation (C-14). Notice that 


m, 
f, 


F'F- [H, GH, H: GH)] 
m; 


m; Hi, m, GH, m, H: m, GH, 
fH, £,GH, fiH- f,GH, 
mo Hi m2 GH, m; H; m; GH, 
LH, £.GH, fH: f,GH, 


where m; and m; are the first row vector and the third row vector of F~', respectively. 
Since F~' F is an identity matrix, we have f, H, = 0, f, H; = 0, f; GH, = 1, fı GH, = 0, 
£H, = 0, C H; = 0, C GH, = 0, and f: GH, = 1. Thus, we have 


f, fH, fH 0 0 
à Tag BG  |tGH, &GH| |10 
H-T H- ,. IH HJ-|ru tH, |=lo 0 
tG f£ GH, £ GH, 0 1 
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Problem C-3 
Consider the system defined by Equation (C-8): 
&(k + 1) = T GT&(k) T^! Hu(k) = G&(k) + Hu(k) 


where the transformation matrix T is defined by Equation (C-12). Assume that the 
matrix G is given by Equation (C-15) and the matrix H is given by Equation (C-16). 


That is, 
0 1 0 | 0 0 0 
-|° 9 110 a-|9 0 
Leu ae n ids 1l 5» 
án “ân >a | Zaa 0 1 
Show that 
^b z? + dis z? + a2zZ+ ay Ais 
Iz1 G| B 23 z? + anz + a2 zt 24 
and 
0 1 0 0 
^ ^ 0 0 1 0 
- ABA = 
G an — n -@2- 62 a3 ~ 63 ~au ~ ĝi 
—üza — 05 an — 862 —Ax — 823 an — ĝu 
where 


B= 1 bi " A- Ôn O5 s Bg 
0 1 , 62i 02; 823 854 
Show also that if we choose, for example, 


a= [=e —ài Tans Bil (C-30) 


* * * — 024 


where the elements shown by asterisks are arbitrary constants, the system will exhibit 
the deadbeat response to any initial state x(0); that is, 


(G-ÉBAY*-0, k-4,56,... 

Show also that if we choose 
[Lm can 
then 
(G - HBA) = 0 

for k = nmin, where 

nmin = max (ni,n;) = max (3,1) = 3 
Solution For the case where G is as given by Equation (C-15), we have 


z -i1 0 0 
0 z -1 0 
a, 42 Zt a4 
a2 2 23 Z + da 


zI - 6| = 
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Expanding this determinant using the Laplace's expansion formula, we obtain 


|zI _ 6| = l d l t a3 i4 - zZ -1 -1 0 | 
0 z a23 Z + da âu Aniläz Z + Oy 

"E -1 -1 0 

a2 d»ldz tas du 


= (z t ax)(z? + az? + AZ + a) = au (az z? + anz + an) 


Hence, the determinant |zI — G| may be written as follows: 


^| 2 + a zi + anz + ai ai4 
zl G| ~ | 023 z? + anz + 2i z+ (24 (c-32) 
Next, compute 
0 0 a 
r3 E 0 0 1 bi; bu i 513 514 
HBA -|1 p, E 1 | B ôn ôn a 
0 1 
0 0 0 0 0 0 
[0 Olf6. à» à» &x].|0 o o o 
1 0 85 522 523 024 ài 1 i; i 814 
0 1 ôn 82 ôn 824 


(Notice that the effect of postmultiplying matrix H by matrix B is to eliminate b; from 
the product matrix HB.) Thus, 


0 1 0 0 
^ ^ _ 0 0 1 0 
G - HBA = Zan — ôn —@2— ðn -43—05 aia — 64 
ay — ôn -an — ôn -an — 823, -—a4-— 64 
If we choose A as given by Equation (C-30), then 
0100 
^ we, 10010 
G — HBA = 0000 
x * * 0 


where the elements shown by asterisks are arbitrary constants. Notice that 


0010 
^ n ,.|[000 0 
(G HBA =|) 00 0 
0 * * 0 
0000 
^ 5n 3 |]0000 
(G HBA =| 00 0 
00* 0 
0000 
^ n 4 10000 
(G HBA) =| 9 0 0 
0000 
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Hence, 
x(k) = (G - HK)*x(0) = T(G - HBA)'Tx(0 2-0, kzd4 


We have thus seen that the deadbeat response is achieved by choosing A as given by 
Equation (C-30). 
However, if we choose A as given by Equation (C-31), then the deadbeat response 


can be achieved in at most three sampling periods, because the asterisk appearing in 
(G — HBA)’ becomes zero and 


x(k) = T(G - HBAFT^"x(0 2-0, k = nmin = 3 
Problem C-4 
Consider the following system: 
x(k + 1) = Gx(k) + Hu(k) 


where 
x(k) = state vector (4-vector) 
u(k) = control vector (2-vector) 
and 
-1 1 00 0 1 
| 1-2 10 _ : _{1 0 
S-|o 1 -1 2p) B-IBcBEl-], 9 
1 0 01 1 0 


By use of the state feedback control u(k) = —Kx(k), we wish to place the closed-loop 
poles at the following locations: 


zı = 0.5 + j0.5, z2 = 0.5 — j0.5 
23 = —0.2, Z4 = —0.8 


Determine the required state feedback gain matrix K. Then, using the given G and H 
matrices, derive Equation (C-16). 


Solution We shall first examine the controllability matrix: 
[H : GH: GH:G?H] = (H, : H2: GH, : GH, : GH, : G? H; : G° H, | G° Hi] 


t0 11] 1! -1 {+31 2 n -5 
_fiattoli-2! 1i ! 8| -3 -2 n , 
"Holioi 3! 0 i-3| 3 15 -6 (9593) 

abo a} :i2 0 c 2 


The rank of this controllability matrix is 4. Thus, arbitrary pole placement is possible. 
Four linearly independent vectors are chosen starting from the left end. (These vectors 
are shown enclosed by dashed lines.) The four linearly independent vectors chosen are 
Hı, H;, GH;, and G?H,. Now we rearrange these four vectors according to Equation 
(C-10) and define matrix F as follows: 


F- [H. : GH, : G? H; : H;] 


We note that n; = 3 and n; = 1 in this case. Rewriting matrix F, we have 


0 11-3 1 
t I 
F = [2-72.48 0|.|A, B 
0 317-3 0 CD 
1 1120 
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Next, we compute F^!. Referring to Appendix A, we have 


rie |^ + A" B(D - CA^B)'CA" -A^B(D- a 


-(D ~ CA^!B)'' CA^ (D - CA^! B)! 
0 -1 4 2 
-|0 d 3-3 
0j dd 
1 3 4d 


(The same result can be obtained easily by use of MATLAB.) Since n, = 3 and m = 1, 
we choose the third row vector as f, and the fourth row vector as f;. (Note that we define 
the nth row vector, where n; = n, + n2 +--+ + n, as fj.) That is, 


&-[o d d -4 
b-[ 34 o] 


Next, we define the transformation matrix T by 


-1 
NE 


where 
f, 
Si = fiG , S- = [f] 
fı G? 
Hence, 
0 1 2-1| f-1101 
T= 0-$ 0 i|. 1010 
0 2-1 1 3300 
1 2 1 -2 1310 
With this transformation matrix T, if we define 
x(k) = T&(K) 
then 
0 1 010 
A mi .|]00 150 
G-T' GT- o 3 -2 i1 (C-34) 
20 0 -1 
Also, 
0 1 1 -i1[0 1 0 0 
Tig |0 3 O i$|[10/|.100 7 
H-T'H- 0 2-1 1|00 10 (C235) 
1 2 4 -ij10 0 1 


Now we shall determine the state feedback gain matrix K, where 


K = BAT 
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Referring to Equation (C-24) and noting that b,. = 0 in this case, matrix B isa 2 X 2 


matrix given by 
[1 bel’ [10 
Baf} ^p - [12 (C-36) 


For the present case, A is a 2 X 4 matrix: 


A = 6 à 513 514 
65 ðn ôn ôu 


Hence, 
0 1 0 | 0 
^ ^ » 0 0 1 ! 0 
GO MBA@| 81 3-5: -2- 8g] 1- 8u 
2 — 684 —02 —ó5 !—-1-ó4 


Referring to Equation (C-32), we have 
^ f z? + (2 + dis)z” (-3*82z + ôn | -1 + ôu 
I - G + HBA| = |--------3---~--------<---<-~-----4---------- - 
lz | 82327 + bnz + (-2 + 631) E +1+ 024 
This characteristic equation must be equal to the desired characteristic equation, which 
is 


(z — 0.5 — j0.5)(z — 0.5 + j0.5)(z + 0.2)(z + 0.8) = z* — 0.34z + 0.34z + 0.08 = 0 


If we equate the coefficients of the equal powers of z of the two characteristic equations, 
we will have four equations for the determination of eight 6’s. Hence, matrix A is not 
unique. Suppose we arbitrarily choose 


Sys = 0, 62; = 0, 823 = 0, 24 = -1 


a 


Then 
zI- 6 HBA| = z4 + (2 + d3)2? + (-3 + 82)27 + êuz — 2+ dn = 0 


By equating this characteristic equation with the desired characteristic equation, we 
have 


ài = 0.34 
ài; = 2.66 
63 = -2 

821 = 2.08 


Thus, 


2.08 0 0 -1 
Then matrix K is obtained as follows: 


0 -2.1067 0.7800 0.1067 
—1 0.02667 0.3600 -0.02667 


With the matrix K thus determined, state feedback control 
u(k) = -Kx(k) 


a= | 2.66 -2 °] 


K = BAT! -Í 
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will place the closed-loop poles at zı = 0.5 + j0.5, z2 = 0.5 — j0.5, z; = —0.2, and 
Za = —0.8. It is noted that matrix K is not unique; there are many other possible 
matrices for K. 

Finally, we shall derive Equation (C-16). Notice that 


m, 


F'F- P [H, GH, G'H, Hj 


m,H, m GH, m, G H, mH; 
mH, mGH, m GH, m; H: 
fiHi f,GH, f,GH, fH, 
LH, £GH, £G°H, fH, 0 0 


where m, and m, are the first row vector and second row vector of F^, respectively. 
Since F' F is an identity matrix, fi Hi = 0, fi H; = 0, fi GH, xd 0, f G? H, = 1, f H, = 
0, and £; H, = 1. From Equation (C-33) we see that GH; is linearly dependent on Hi, 
Hz, and GH;. Hence, fı GH; = of, H, + Bf, H, + yf; GH, = 0, where a, B, and y are 
constants. Note that fı G^ H; may or may not be zero. Consequently, 


f, f; Hi f; H; 0 0 


O Om 


0 
1 
0 


O.o 
ese OOO 


ry = -1 2 f, G = f GH, f, GH, = 0 0 
H= TH =/ eg? |$ Bel fiGH, fiGH;| |1 b» 
f, fH, fH, 0 1 
where bi; = fı G^ H;. This last equation is Equation (C-16). 


Problem C-5 


Referring to Problem C-4, consider the same system. Suppose that we desire the 
deadbeat response to an arbitrary initial state x(0). Determine the state feedback gain 


matrix K. 
Solution Referring to Equations (C-34), (C-35), and (C-36), we have 
01 0!0 0 0 
a [00 1; 0 5.100 
Slo 3 -2t ap Boo 
20 O}-1 0 1 
-1 


where b;; is zero. For the deadbeat response, we choose A as follows: 
A- “A. a2 -5 -—üu zu 03 -2 1 
—ü» âz —ü5, -—ü 2 0 0 -1 


. where the a;;'s are as defined in Equation (C-15). Then 


0100 
< an NOOO 0 
G-HBA=| 9 0 0 

0000 


and we find 
(G - HBA)‘ =0, k =3,4,5,... 
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The deadbeat response is reached in at most three sampling periods. [Note that in this 
problem n, = 3 and m = 1. Hence, nmin = max (nı, n2) = 3.] The desired state feed- 
back gain matrix K is obtained as follows: 


K = BAT! 


his 


O vr 
WAN Ule Gol ool 


l 
m. 
Ó—oo0c 
| 


WIN Baltes Gab Gab 
Ww Gale 


I 
m 
| 

— 

| 
Som 
wpe =e 

| 
Our 
LLLLLÉIIQ 


With this matrix K, the state feedback control 
u(k) = —Kx(k) 


will place the four closed-loop poles at the origin and thus will produce the deadbeat 
response to any initial state x(0). 


il 
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Absolute stability, 193 
Ackermann's formula: 
for minimum-order observer design, 
450, 454 
for observer design, 435—438, 440, 445 ‘ 
496 
for pole placement, 408—412, 466, 493 
Actuating error, 200 
A/D converter, 15 
counter type, 15 
successive-approximation type, 15 
Adjoint vector, 572 
Alias, 98 
Amplitude quantization, 8 
Analog controller, 21 
Analog multiplexer, 12 
Analog signal, 1-2 
Analog-to-digital conversion, 14 
Analog-to-digital converter, 7 
Analog transducer, 7 
Analytical design method, 242—257 


Angle: 
of arrival, 209 
of asymptote, 207—208 
of departure, 209 
Aperture time, 14 
Associativity law, 638 
Asymptotic stability, 325 
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Backward difference: 
first, 697 
mth, 698 
second, 698 
third, 698 
BIBO stability, 326 
Bilinear form: 
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Bilinear transformation, 191, 228, 231 
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Block diagram: 
of continuous-time control system in 
state space, 296 
of discrete-time control system in state 
space, 296 
Bode diagram, 232-233 
Bounded-input-bounded-output stability, 
326 
Breakaway point, 208—209 
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controllable, 297—298, 300, 396, 398, 
489 
diagonal, 299—300, 399, 489 
Jordan, 300, 302, 382, 390, 399—400, 
651—652, 657, 659, 674 
observable, 298—300, 398—399, 489 
Cauchy-Goursat theorem, 688-689 
Cayley-Hamilton theorem, 350, 380, 404, 
408, 481, 485, 492 
Characteristic polynomial, 649 
Characteristic roots, 650 
Clamper, 78 
Coding, 6, 8 
Coefficient quantization problem, 234 
Compensation: 
phase lag, 233 
phase lag-lead, 233 
phase lead, 233 
Complementary strips, 175 
Complete observability. (See 
Observability.) 
Complete state controllability. (See 
Controllability.) 
Complex convolution theorem, 684 
Complex differentiation, 681—682 
Complex integration, 682—683 
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Complex translation theorem, 34 
Conformal mapping, 180 
Constant-attenuation loci, 176-177 
Constant-damping-ratio loci, 178-180 
Constant-frequency loci, 176-178 
Continuous-time analog signal, 1-2 
Continuous-time quantized signal, 1-2 
Contraction, 334—335, 367—368 
Control energy, 622 
Controllability, 377, 379 
complete output, 385—386 
complete state, 380—384, 387, 393, 406 
matrix, 380, 401, 707—708 
output, 387 
in the z plane, 384 
Controllable canonical form, 297—298, 300, 
396, 398, 489 
Convolution integral, 84—85 
evaluation in the left half-plane of, 
84-86 
evaluation in the right half-plane of, 
86-88 
Convolution summation, 98, 100 
Convolution theorem: 
complex, 684 
real, 684 
Coprime polynomials, 518, 541 
Covector, 572 
c2d, 628 
Current observer, 444 
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D/A converter: 
using R-2R ladder circuit, 17-18 
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Data-acquisition process, 12 
Data-acquisition system, 11-12 
Data-distribution process, 12 
Data-distribution system, 11 
Data-hold, 6, 77 
Data-hold circuits, 77 
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Deadbeat response, 242, 248, 411, 
414-418, 435, 439—442, 444, 
453—454, 470—471, 490, 494, 498, 
502-505, 508, 550, 712-713, 715, 
717—718, 723, 728-729 

Decoder, 7 

Decoding, 6 

Definiteness: 

negative, 661 
positive, 660 

Delay time, 194-195 

Demultiplexer, 13 

Derivative gain, 116 

Derivative time, 115 

Design: 

based on analytical method, 242-257 

based on frequency-response method, 
225—242 

based on pole placement, 402—421 

based on pole placement with observed 
state feedback, 421—460 

based on polynomial equations 
approach, 517—540 

based on root-locus method, 204—225 

Determinant, 633—635 
properties of, 634—635 
Diagonal canonical form, 299—300, 399, 
489 
Differentiation: 
in the z plane, 165 

Digital control system, 3, 5 

Digital controller, 20 
realization of, 122 

Digital filter, 122 
block diagram realization of, 122 
direct programming of, 123-124, 133 
ladder programming of, 128—135 
parallel programming of, 127-128 
parallel realization of, 163—165 
series programming of, 126-127 
series realization of, 163—165 
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Digital filter (cont.) 
standard programming of, 124-125, 
133-134 
Digital integrator: 
bilinear, 172 
with delay, 171—172 
without delay, 171 
Digital PID control: 
positional form, 116 
velocity form, 117 
Digital PID controller, 114-118 
Digital signal, 2-3 
Digital-to-analog converter, 7, 16 
Digital transducer, 7 
Diophantine equation, 518, 520-521, 
523—525, 529, 533, 535, 547, 551, 
555, 559 
solution to, 520-521 
Diophantus, 518 
Direct division method, 40—42 
Direct method of Liapunov, 322 
Direct programming, 123 
method, 336 
Discrete-time control system, 3 
Discrete-time signal, 2-3, 23 
Discretization, 6, 394 
of continuous-time state space equation, 
314 
Domain of attraction, 325 
Double integrator system, 361-362, 439, 
490, 513 
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Eigenvalue, 649-650, 678 

Eigenvector, 650, 674 
generalized, 654, 656 
normalized, 650 

Encoder, 7 

Encoding, 6, 8 

Equilibrium state, 324 
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Errors in A/D converters: 
gain error, 16-17 
linearity error, 16-17 
offset error, 16-17 

Euclidean norm, 324 


F 


Fibonacci series, 67—69 
Filter, 603—604 
Final value theorem, 36 
Finite-impulse response filter, 135—137 
First-order hold, 19, 80—82, 139—140 
interpolative, 19-20 
magnitude and phase characteristics of, 
151-153 
transfer function of, 80—82 
Folding, 96 
error, 97 
frequency, 96 
Format: 
long, 318 
short, 318 
Forward difference, 322 
first, 698—699 
mth, 699 
second, 698 
third, 698 
Frequency-response method, 225-242 
Frequency spectrum: 
of complementary components, 92 
of ideal low-pass filter, 92-93 
of primary component, 92 
of sampled signal, 91-92 
Full-order state observer, 426—444 
Fundamental matrix, 303, 309 


G 


Gain crossover frequency, 274 
Gain error of A/D converter, 16-17 
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Generalized eigenvector, 494, 496, 498, 
654, 656, 674 


H 


Hermitian form, 660 
Hermitian matrix, 633 
Hidden instability, 334 
Hidden oscillation, 98, 361 
Higher-order hold circuits, 19, 82 
Hold circuits, 17-18 
Hold mode, 13 
droop, 14 


I 


Ideal filter: 
magnitude characteristics of, 92 
unit-impulse response of, 93-94 
Ideal low-pass filter, 92—93 
Impulse sampler, 75-77, 83 
Impulse sampling, 75, 77 
Indefinite matrix, 661 
Indefiniteness: 
of scalar function, 661 
Infinite-impulse response filter, 135 
Initial value theorem, 35 
Inner product, 643—645, 647 
Instability, 325, 327—328 
Integral gain, 116 
Integral time, 115 
Interpolative first-order hold, 19-20 
Invariance: 
of characteristic equation, 312 
property, 401 
Inverse z transform, 37, 687 
computational method for obtaining, 
42-46 
difference equation approach to obtain, 
46 
direct division method for obtaining, 
40-42, 62 
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Inverse z transform (cont.) 
inversion integral method for obtaining, 
50—52, 60—62, 64—66 
MATLAB approach to obtain, 42-45 
partial-fraction-expansion method for 
obtaining, 46—50, 64 
Inverse z transformation, 37 
Inverse of zI — G: 
computation of, 304—309 
Inversion integral: 
for the z transform, 689 
Inversion integral method, 50-52, 60-62, 
64—66 
Inverted pendulum control system, 596 
Inverted pendulum system, 597, 625—628 
Isolated equilibrium state, 324 


J 

Jacobian, 641 

Jordan block, 383, 651—652 

Jordan canonical form, 300, 302, 382, 390, 
399—400, 651—652, 657, 659, 674 

Jury stability table, 185, 187—188 

Jury stability test, 185-190 


K 


Kalman, R. E., 377 

Kronecker delta function, 42, 62 
Kronecker delta input, 43, 103 
Kronecker invariant, 708 


L 


Ladder programming, 128-135 

Lag compensator, 224, 273-274 
Lagrange multiplier, 570—572 

Laplace's expansion by minors, 541, 634 
Laurent series expansion, 141, 687, 689 
Lead compensator, 262, 272-273 

Left pseudoinverses matrix, 665—666 
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Liapunov: 
direct method of, 322 
first method of, 321 
function, 322—323, 334, 591 
second method of, 321-322 
Liapunov stability analysis, 321-336 
of continuous-time system, 329-332 
of discrete-time system, 332-334 
first method of, 321 
second method of, 321—322 
Liapunov theorems: 
on asymptotic stability, 326-327 
on instability, 327—328 
on stability, 327 
Liapunov's main stability theorem, 326, 
363-365 
Linear dependence of vectors, 643 
Linear discrete-time state equation: 
solution of time-invariant, 302—309 
solution of time-varying, 309—310 
Linear independence of vectors, 643 
Linear system, 3 
Linear time-varying discrete-time system, 
309—310 
Linearity error of A/D converter, 16-17 


M 
Mapping: 
between s plane and z plane, 174—182 
from s plane to z plane, 229 
from z plane to w plane, 229 
MATLAB programs: 
for finding Fibonacci series, 68 
for finding inverse z transform, 44, 63 
for finding response to Kronecker delta 
input, 45 
for finding unit-ramp response, 120, 
260, 459, 531 
for finding unit-step response, 119, 196, 
240, 268, 421, 458, 530, 605—606 
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MATLAB programs (cont.) 

for pole placement in the z plane, 

500—501 
for quadratic optimal control, 579, 
590—591, 600—603, 615 

Matrix: 

cancellation of, 639 

derivative of, 640 

diagonalization of, 651, 653 

differentiation of, 640 

eigenvalue of, 649-650 

eigenvector of, 650 

exponential, 313 

Hermitian, 633 

indefinite, 661 

integral of, 640 

inverse, 635—637 

inversion lemma, 573, 636, 668 

multiplication by a matrix, 637 

multiplication by a scalar, 637 

negative definite, 661 

negative semidefinite, 661 

nonsingular, 635 

norm of, 647 

normal, 633 

positive definite, 661 

positive semidefinite, 661 

rank of, 649 

rules of operations of, 637—643 

similar, 651 

singular, 635 

skew Hermitian, 633 

skew symmetric, 633 

stable, 365 

symmetric, 633 

trace of, 658 

unitary, 645 
Maximum overshoot, 195 
Minimal left inverse, 666 
Minimal polynomial, 350—354 
Minimal right inverse, 665 
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Minimum control energy, 622 
Minimum norm solution, 624 
that minimizes ||Ax — b||, 665 
that minimizes ||x||, 663—665 
Minimum-order observer, 446—450, 
452-454, 469-470, 502-504 
Model matching control system, 532-534, 
536—537, 561 
Modified z transform, 691—696 
Monic polynomial, 518 
Moving average filter, 136 
Multiple-order sampling, 8 
Multiple-rate sampling, 8 
Multiplexer, 12 


N 


Negative definite matrix, 661 
Negative definiteness: 

of scalar function, 661 
Negative semidefinite matrix, 661 
Negative semidefiniteness: 

of scalar function, 661 
Nested programming method, 338, 343 
Nilpotent matrix, 414—416 
Nonminimum phase transfer function, 233 
Nonrecursive filter, 136-138 
Nonsingular matrix, 635 
Norm, 645—647 

Euclidean, 324 
Normal matrix, 633 
nth-order hold, 77 
Nyquist frequency, 96 


(0) 


Observability, 377, 388 
complete, 389-390 
matrix, 389, 394, 401 
in the z plane, 391—394 
Observable canonical form, 298-300, 
398—399, 489 


Index 


Observation, 422 
Observed-state feedback control system, 
428, 434 
with minimum-order observer, 447, 
451-452 
Observer error equation, 428, 443, 445, 
450 
Observer feedback gain matrix, 427, 434, 
438, 442, 449—450, 496, 499 
Observer poles, 428 
Observer regulator, 502, 505, 543 
Optimal control law: 
minimum energy, 622-625 
quadratic, 568-596 
Optimal control system, 566, 568 
Optimal control vector, 567 
closed-loop form, 574 
feedback form, 574 
Optimal regulator system, 566 
Orthogonal matrix, 633 
Orthogonal set, 648 
Orthogonal transformation, 645 
Output controllability, 387 


P 


Parallel programming, 127-128 
Parameter optimization problem, 591 
Parseval's theorem, 686 
Partial differentiation theorem, 683 
Partial-fraction-expansion method, 46-50 
Partial-fraction-expansion programming 
method, 339-341, 345 

PD controller, 234 
Peak time, 195 
Performance index, 566 

including cross term, 582 

minimum value of, 575 
Periodic sampling, 8 
Phase lag compensation, 233 
Phase lag compensator, 234 
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Phase lag-lead compensation, 233 
Phase lag-lead compensator, 233 
Phase lead compensation, 233 
Phase lead compensator, 234, 237 
Physical realizability: 
condition for, 244—245 
PI controller, 234 
PID control action: 
analog controller, 115 
PID controller, 117—118, 121, 233-234 
analog, 156-159 
digital, 156—159 
positional form, 116 
velocity form, 117, 157, 159—160 
Plant, 7 
Pole assignment technique, 402 
Pole placement, 408 
design, 402-421, 707-718 
design with vector control, 704—718 
necessary and sufficient condition for, 
402—408 
Pole-zero cancellation, 211, 479—481 
Pole, 39-40 
Poly, 499 
Polygonal hold, 19-20 
Polynomial equations approach: 
to design control systems, 525-532 
to design regulator systems, 523—525 
Polyvalm, 500 
Positive definite matrix, 661 
Positive definiteness: 
of scalar function, 660—661 
Positive semidefinite matrix, 661 
Positive semidefiniteness: 
of scalar function, 662—663 
test, 680 
Prediction observer, 428 
design of, 430—444 
full-order, 438 
Primary strip, 175 
Principle of duality, 392—394 
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Principle of superposition, 3 
Process, 7 
Proportional gain, 116 
Pseudoinverse matrix: 
left, 665-666 
right, 664—665 
Pulse transfer function, 98, 102, 104—118 
of cascaded elements, 108-110 
of closed-loop system, 110-111 
of digital controller, 111-118 
matrix, 310—312 


Q 
Quadratic form, 659-660 
complex, 660 
real, 659 
Quadratic optimal control: 
of servo system, 596—609 
steady-state, 587-596 
Quadratic optimal control problem: 
discretized, 580—582 
Liapunov approach to the solution of, 
592-596 
steady-state, 592—594 
Quadratic optimal regulator problem: 
Liapunov approach to the solution of, 
591—592 
steady-state, 591—592 
Quadratic performance index, 568 
with cross term, 582 
Quantization, 1, 7 
error, 9 
level, 8-9 
noise, 9, 11, 126 
process, 4 
Quantizer, 9-10 


R 


Radius of absolute convergence, 25 
Random sampling, 8 


Index 


Rank, 649 
Rate time, 115 
Reachability, 474—475 
Real convolution theorem, 684 
Real sampler, 78 
Real translation theorem, 31 
Recursive filter, 135, 137 
Reduced-order observer, 446 
Relative stability, 193, 195, 220 
Reset time, 115 
Residue, 50, 84—85, 145, 399, 688, 
690—691 
theorem, 689 
Response: 
to disturbance, 202 
between two consecutive sampling 
instants, 320-321 
Riccati equation, 573-574 
steady-state, 588—589 
Riccati transformation, 572-573 
Right pseudoinverse, 623—624, 664—665 
Rise time, 195 
Root loci: 
asymptotes of, 207-208 
general rules for constructing, 207—210 
Root locus, 206 
Root-locus method, 205 
angle condition in, 206 
magnitude condition in, 206 
Round-off error, 9 
Routh stability criterion: 
bilinear transformation coupled with, 
191-192, 258-259 


S 


Sample-and-hold, 6 
Sample-and-hold circuit, 13-14 
hold mode operation of, 13-14 
tracking mode operation of, 13-14 
Sampled-data control system, 3 


Index 


Sampled-data signal, 2 
Sampled-data transducer, 7 
Sampling, 6 
frequency, 90 
process, 4 
theorem, 90—92 
Scalar function: 
indefiniteness of, 322 
negative definiteness of, 322 
negative semidefiniteness of, 322 
positive definiteness of, 322 
positive semidefiniteness of, 322 
Scalar product, 643 
Schur-Cohn stability test, 185 
Schwarz inequality, 645—646 
Second method of Liapunov, 322 
Second-order hold, 19 
Series programming, 126-127 
Servo system, 460 
with observed-state feedback, 465 
quadratic optimal control of, 596—609 
with state feedback, 464 
with state feedback and integral control, 
460—461 
Settling time, 195 
Shannon's sampling theorem, 150-151 
Shifting theorem, 31 
Similar matrices, 651 
Similarity transformation, 301, 311—312, 
651-653, 657 
invariant properties under, 659 
Singular matrix, 635 
Sinusoidal pulse transfer function, 227-228 
Skew-Hermitian matrix, 633 
Skew-symmetric matrix, 633 
real, 679 
Square matrix: 
eigenvalues of, 649—650 
ss2tf, 603—604 
Stability, 324 
Liapunov theorem on, 327 
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Stability analysis: 
of linear time-invariant system, 328 
by use of bilinear transformation and 
Routh stability criterion, 191—192 
Stable matrix, 365 
Staircase generator, 78 
Standard programming, 124—126 
Starred Laplace transform, 103—104 
State, 294 
State equation: 
solution of continuous-time, 312 
solution of linear time-invariant discrete- 
time, 302-309 
solution of linear time-varying discrete- 
time, 309-310 
z transform approach to the solution of 
discrete-time, 304—307 
zero-order hold equivalent of contin- 
uous-time, 315—317 
State estimator, 422 
State feedback gain matrix, 402—403, 
410—414, 427, 492, 494 
State observer, 422 
full-order, 422, 426-444 
minimum-order, 446-456 
State observation: 
minimum-order, 422 
necessary and sufficient condition for, 
422-425 
reduced-order, 422 
State space, 294 
State space representation: 
nonuniqueness of, 301 
State transition matrix, 303, 305, 309—310 
State variable, 294 
State vector, 294 
Static acceleration error constant, 200 
Static error constants, 198-201 
Static position error constant, 199 
Static velocity error constant, 199 
Steady-state actuating error, 198—200 
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Steady-state error, 196—197, 200—201 
Steady-state quadratic optimal control law: 
Liapunov approach to, 591—594 
Steady-state response, 193 
Steady-state Riccati equation, 600, 621 
Sylvester, J. J., 661 
Sylvester matrix, 518—520, 524, 535, 
540—541, 548, 551, 559 
Sylvester criterion: 
for negative definiteness, 662 
for negative semidefiniteness, 663 
for positive definiteness, 661—662, 679 
for positive semidefiniteness, 662 
Symmetric matrix, 633 
real, 679 
System, 324 


T 


Time-invariant linear system, 3 

Trace, 307, 658 

Tracking mode, 13 

Transducer, 7 

Transfer function matrix: 
pulse, 310—312 

Transient response, 193 
specifications, 193—195 

Transportation lag, 280 

Two-point boundary-value problem, 572 

Type 1 servo system, 597 

Type 1 system, 197-198 

Type 2 system, 197-198 

Type 0 system, 197—198 


U 


Underdetermined equation, 623 

Uniform asymptotic stability, 365 
in the large, 364—365 

Uniform stability, 324 

Unit delay operator, 40 


Index 


Unit impulses: 

train of, 75 
Unit-ramp function, 26 
Unit-step sequence, 26 
Unitary matrix, 633, 648 
Unitary transformation, 645 


V 


Vector: 
norm of, 645 
normalized, 644 
unit, 648 

Vectors: 
linear dependence of, 643 
linear independence of, 643 
orthonormal, 648 


W 


w plane: 

design procedure in the, 228—242 
w transformation, 228—229, 231 
Weighting sequence, 100 


Z 


z transform, 24 

complex translation theorem of, 34 

convolution integral method for obtain- 
ing, 83 

of cosine function, 28 

definition of, 24 

of exponential function, 27 

final value theorem of, 36 

of first backward difference, 697—698 

of first forward difference, 698—699 

of function involving term (1 — e~™)s, 
88-90 

important properties of, 31 

initial value theorem of, 35 


Index 


z transform (cont.) 

inverse, 37 

inversion integral for, 689 

linearity of, 31 

one-sided, 24—25 

of polynomial function, 27 
properties of, 38 

real translation theorem for, 31 

of second backward difference, 698 
of second forward difference, 698—699 
shifting theorem for, 31 

of sinusoidal function, 27 

table of, 29-30 
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z transform (cont.) 
two-sided, 25 
of unit-ramp function, 26 
of unit-step function, 25, 33 
Zero, 39-40 
Zero-order hold, 18-19, 78, 166 
Bode diagram of, 95 
frequency-response characteristics of, 
94—96 
magnitude and phase characteristics of, 
151-153 
transfer function of, 139 


